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ABSTRACT 


Cumulative  detection  probability,  cdp,  is  defined  as  probability  of  at  least  one 
success  in  n  trials.  "Success"  means  that  the  (signal)  stochastic  process  exceeds 
a  given  threshold.  Exact  formulas  or  approximations  for  cdp  are  given  in  the 
cases  where  the  process  being  sampled  in  the  trials  is  two-state  Markov,  Gaussian, 
"step,"  and  "step -plus -jitter. "  hi  the  two-state  Markov  case,  taken  largely  from 
others,  k-success  formulas  are  also  given.  Finding  cdp  is  equivalent  to  finding  the 
distribution  of  the  maximum  of  a  sequence  of  random  variables  and  to  finding  a 
cumulative  multivariate  distribution. 


t 


TABLE _ OF__C_ONTE_NTS 

ABSTRACT 


PREFACE  iii 

SUMMARY  v 

CHAPTER  I  INTRODUCTION  1 

Background  of  the  Problem  2 

Stochastic  Process  Model  for  cdp  3 

CHAPTER  H  TWO-STATE  MARKOV  PROCESSES  7 

Stationary  Two-State  Markov  Processes  7 

Non-Stationary  Two-State  Markov  Processes  17 

Continuous-Parameter  Two-State  Markov  Processes  18 

Independent  Processes  19 

CHAPTER  HI  GAUSSIAN  PROCESSES  25 

Approximation  Method  25 

Error  Estimates  33 

CHAPTER  IV  STEP  PROCESSES  41 

Definitions  41 

Unimodal  Threshold  Theorems  43 

General  Thresholds — A  Recursive  Scheme  48 

CHAPTER  V  STEP-PLUS-JITTER  PROCESSES  53 

Definitions  54 

Exact  Recursive  Formula  for  cdp  55 

The  2-Dependent  Approximation  56 

The  m-dependent  Approximation  67 

REFERENCES  71 


{ 

4 

| 

i 


TABLE _ gF__C_ONTE_NTS  JContlnuedl 


APPENDIX  A 
APPENDIX  B 

APPENDIX  C 


SOME  FUNDAMENTALS  OF  STOCHASTIC  PROCESSES 

LITERATURE  SURVEY  ON  EVALUATING  THE  MULTIVARIATE 
NORMAL  DISTRIBUTION 

CORRELATION  THEOREMS 


ii 


PREFACE 


This  is  a  report  to  the  U.  S.  Navy  Underwater  Sound  Laboratory  under  Contract 
Number  N140(70024)74322B  as  part  of  an  investigation  of  optimal  search  procedures 
for  surface  ship  sonar.  The  report  is  related  to  other  reports  on  the  project  as 
follows:  A  previous  report,  reference  [a],  presented  stochastic  process  inferences 
from  empirical  sonar  data;  these  inferred  processes  underlie  most  of  the  theoretical 
analysis  in  the  present  report.  A  forthcoming  report  will  present  results  on  optimal 
search  procedures;  the  analysis  will  depend  heavily  upon  some  of  the  methods  dis¬ 
cussed  herein. 

We  wish  to  acknowledge  the  splendid  direction  and  cooperation  we  have  received 
during  this  work  from  Mr.  Carleton  S.  Walker  of  the  System  Planning  Staff  at 
USNUSL,  and  through  him,  from  Mr.  Stanley  A.  Paterson,  Associate  Technical 
Director  for  Systems  Development.  We  further  acknowledge  the  valuable  assistance 
of  our  colleague,.  Mr.  David  C.  Bossard,  who  reviewed  previous  work  on  two-state 
Markov  processes  and  contributed  Theorems  H-l  and  H-2  in  Chapter  DL 

One  of  the  authors,  Professor  Edward  S.  Boylan,  has  returned  to  Rutgers,  The 
State  University,  after  participating  in  this  investigation  during  the  summer  of 
1964. 
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SUMMARY 


This  report  presents  methods  of  computing  cumulative  detection  probability  (cdp), 
i.  e. ,  the  probability  of  at  least  one  successful  detection  in  n  trials.  This  is  equivalent 
to  the  problem  of  computing  the  (cumulative)  distribution  of  an  n-dimensional  random 
variable,  and  to  the  problem  of  computing  the  distribution  of  the  maximum  of  an 
n-term  sequence  of  random  variables.  In  this  summary  we  describe  the  stochastic 
process  model  used  and  the  nature  of  the  results  for  various  types  of  processes. 


Stochastic  Process  Detection  Model 


We  fix  a  continuous-parameter  stochastic  (signal)  process  X*  (which  associates 
to  time  t  a  random  variable  X^)  and  a  threshold  function  T*.  These  determine  a 
success-failure  process  D*:  Detection  at  time  t  means  X*  >  T*  or  equivalently, 

D*  =  l;  no  detection  means  Xt  <  T^,  i.  e. ,  D*  =  0.  If  X*  is  sampled  (observed)  at 
*!»•••  »th>  denote  x|i=Xj,  T$.  =  Ti,  and  D^  =  D£.  Define 


p*ti  =  Pi  =  Pr{Xi>  Tj,} 

and 

c<%)  =  Pn  =  Pr  {  Xj  >  Tj  for  some  i,  1  1  i  <  n}  . 


The  problem  is  to  compute  Pn  under  various  assumptions  on  X*  or  X.  la  Chapter  I, 
the  model  is  developed  in  more  detail  and  background  of  the  problem  is  given. 


Two-State  Processes 

Two-state  Markov  processes  are  investigated  in  Chapter  n.  Attention  is  confined 
to  the  discrete-parameter  success-failure  process  D  (and  briefly  to  D*),  ignoring 
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X*  and  X.  It  is  assumed  that  D  is  Markovian.  Most  of  the  results  are  taken  from 
previous  literature. 


If  D  is  stationary  (i.e.  ,  independent  of  i,  pj=p,  and  r.  =r,  the  correlation 
between  Dj  and  D|+1),  then  D  is  characterized  by  a  single  2x2  transition  matrix  (II-l). 
The  transition  probabilities  are  expressed  in  terms  of  p  and  r,  and  conversely. 

Formula  (II- 2)  gives  the  probability  of  exactly  k  successes  in  n  trials  (for  k=  0, 1, 2, . . . ) 
by  means  of  a  generating  function.  These  are  added  to  form  probabilities  of  at  least  k 
successes  (Pn  if  k  =  l),  explicitly  given  in  formulas  (II-3)  for  k=l  and  k=2.  (Other 
than  in  Chapter  II,  the  report  is  restricted  *o  k=l. )  Also  given  is  the  probability  of 
at  least  two  consecutive  successes.  These  probabilities  are  presented  graphically  in 
Figures  H— 1  through  IE-6  for  various  r,  n,  p,  *>nd  for  k=  1,  2. 

If  D  is  non-stationary,  then  the  situation  for  k=l  is  only  slightly  more  complicated. 
The  transition  probabilities  are  given  by  formulas  (II-4)  in  terms  of  pA  and  rj  which  now 
depend  on  i;  Pn  is  given  by  (H-5). 

When  the  number  of  observations  n  in  a  fixed  interval  (with  D  stationary)  is  made 
to  approach  infinity,  Poo  =  limn_>0O  Pn  is  given  by  Theorem  II-l.  This  represents 
cdp  for  a  continuously  observed  process;  Poo  is  graphed  in  Figure  n-7. 

For  a  sequence  of  independent  trials,  a  generating  function  is  given  in  Theorem 
H-2  for  the  probability  of  exactly  k  successes.  This  is  applied  explicitly  to 
k=l,  2,3,  and  k=0  is  elementary.  The  formulas  reduce  to  the  binomial  distribution 
if  pj  is  independent  of  i. 


Gaussian  Processes 

If  X*  is  Gaussian,  then  computation  of  Pn  is  equivalent  to  computation  of  a  multi¬ 
variate  normal  distribution.  This  is  investigated  in  Chapter  III  —  previous  literature 
is  reviewed  in  Appendix  A. 

The  principal  method  offered  in  this  case  is  a  convenient  approximation  based 
on  the  assumption  (used  in  Chapter  II)  that  the  discrete-parameter  success-failure 
process  D  is  Markovian.  Computation  aids  (constructed  from  bivariate  normal 
tables)  are  presented  in  Figures  DI-1  through  HI-4,  and  application  is  illustrated  by 
a  tabulated  example. 

For  the  purpose  of  investigating  the  error  in  this  approximation  to  Pn, 

Theorem  IH-1  reduces  the  problem  for  n=3  to  a  one -dimensional  integration,  under 
the  assumption  that  (X1 ,  X2,  X3)  is  Markovian  as  well  as  Gaussian;  formula  (HI-2) 
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gives  a  corresponding  result  for  n  =  5,  requiring  bivariate  rather  than  univariate 
normal  tables  for  inputs  to  the  integration.  Theorem  HI-2  shows  that  under  the 
assumption  that  X  is  Markovian,  the  approximation  to  P3  is  no  less  than  the  true 
Pg,  and  an  exact  formula  is  given  for  the  error.  A  bound  on  this  error  expression 
is  given  by  Theorem  HI-3. 

Examples  of  the  error  in  the  approximation  are  presented  in  Table  HI-1, 
primarily  for  n  =  3  or  5  and  X  Markovian.  The  errors  in  Pn  are  of  the  order  of 
.  01  or  less.  Under  these  conditions,  the  approximation  appears  to  be  very  good, 
and  the  errors  do  not  appear  to  grow  substantially  as  n  increases  from  3  to  5. 
Neither  stationarity  in  X  nor  constant  T  appear  important  for  accuracy.  However, 
in  a  special  case  where  X  is  not  Markovian,  the  approximation  is  rated  fair  at  best. 


Step  Process 

A  step  process  X*  is  one  in  which  each  realization  is  a  step  function,  with  the 
jumps  occurring  in  a  Poisson  process,  and  with  the  sampled  values  before  and 
after  a  jump  being  independent  draws  from  a  fixed  distribution.  For  tikis  type  of 
process,  cdp  is  investigated  in  Chapter  IV. 

An  exact  formula  for  Pn  is  given  in  Theorem  IV-1  in  the  "unimodaU'  e, 
wherein  the  threshold  is  non-increasing  prior  to  a  minimum  point  and  is  nou- 
decreasing  thereafter.  The  corollary  gives  a  neat  form  of  this  formula  for  the 
case  where  the  observations  are  uniformly  spaced.  ,The  latter  formula  is  used 
in  Theorem  IV-2  to  pass  to  a  limit  to  obtain  P*  — this  includes  the  constant- 
threshold  case  of  Theorem  II-l  as  a  special  case.  The  monotonic  case  of  this 
theorem  was  known  previously. 

Without  the  assumption  of  unimodal  thresholds,  convenient  exact  formulas 
have  not  been  found  in  closed  form;  however,  an  exact  recursive  procedure  is 
given  for  Pn.  The  required  number  of  multiplications  is  in  the  order  of  n2,  and 
thus  the  recursive  procedure  appears  more  efficient  than  a  straightforward 
approach,  which  would  require  over  2n-l  multiplications. 


Step-Plus-Jitter  Process 


A  step-plus-jitter  process  X*  is  the  sum  of  a  step  process  Z*  and  a  jitter 
process  J*;  it  is  assumed  that  J*  is  independent  of  Z*  and  of  itself.  The  cdp 
problem  for  X*  of  this  type  is  investigated  in  Chapter  V. 
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The  assumption  of  unimodai  thresholds  is  no  longer  helpful.  An  exact  (but 
laborious)  method  of  computing  Pn  is  given  by  recursive  formulas  in  the  same 
vein  as  for  the  pure  step  process  of  Chapter  IV. 

An  approximation  to  cdp  is  derived  by  means  of  an  "m-ihdependent"  process, 
wherein  each  observation  depends  only  on  the  outcomes  of  th£  preceding  m  trials. 
The  parameters  of  the  m-independent  process  are  chosen  to  mak*  it  resemble 
the  step -plus -jitter  process. 

This  is  applied  to  obtain  an  approximation  to  Pn,  by  means  of  a  recursive 
procedure  (which  requires  much  less  computation  than  the  exact  procedure).  The 
accuracy  of  this  approximation  is  illustrated  for  m  =  2  in  Figures  V-l,  V-2,  and 
V-3.  Applied  to  a  pure  step  process,  the  approximation  is  very  accurate.  When 
jitter  is  present  (of  a  particular  uniformly -distributed  type),  the  approximation 
appears  to  be  good,  providing  there  is  a  high  probability  of  jumps  between 
observations;  if  this  probability  is  not  much  highei  than  1/3  (the  lowest  value 
for  which  the  approximation  can  be  used  with  m=  2),  then  the  accuracy  is  not  as 
good,  but  it  is  still  much  better  than  an  estimate  based  on  an  independence 
assumption. 


Miscellaneous 


Appendix  A  surveys  various  fundamentals  relevant  to  stochastic  processes. 
Definitions  and  elementary  properties  are  given  for  n-dimensional  random 
variables  and  their  distributions,  correlation,  stochastic  processes  with  emphasis 
on  Markov  processes,  and  related  concepts. 

Previous  publications  on  computing  the  multivariate  Gaussian  distribution  are 
reviewed  in  Appendix  B.  Surprisingly  little  appears  to  be  known  on  the  problem. 
Formulas  i'or  Gaussian  cdp  are  cited  in  some  very  special  cases,  which  do  not 
appear  to  be  of  much  practical  interest  for  present  purposes. 

Appendix  C  presents  some  statements  on  correlation.  Theorem  C-l  gives  the 
autocorrelation  of  the  sum  of  two  stochastic  processes.  Theorem  C-2  gives  some 
basic  facts  on  correlation  between  two  two-state  random  variables.  Theorem  C-3 
gives  an  inequality  comparing  the  correlation  between  two  Gaussian  variables  with 
the  correlation  between  the  corresponding  two  success -failure  variables  obtained 
by  thresholding;  the  latter  correlation  is  smaller.  Theorem  C-4  shows  that  the  auto¬ 
correlation  of  a  step  process  equals  that  of  the  associated  success-failure  process 
obtained  by  thresholding;  both  autocorrelations  are  exponential  decay. 


THEORY  OF  CUMULATIVE  DETECTION  PROBABILITY 


CH_4PTE_R  __I 
INTRODUCTION 


This  report  is  addressed  to  the  theoretical  aspects  of  the  problem  of  computing 
cumulative  detection  probability,  cdp,  i.e. ,  the  probability  of  at  least  one  success 
in  a  sequence  of  detection  trials.  This  problem  has  arisen  in  several  ways  during 
an  investigation  of  optimal  sonar  search  procedures,  conducted  for  the  Underwater 
Sound  Laboratory.  Common  practice  has  been  to  treat  successive  detection  trials 
(e.g. ,  pings)  as  being  statistically  independent.  One  quickly  sees  that  when  this 
assumption  is  not  satisfied  (as  is  usually  the  case),  then  absolute  estimates  of  cdp 
can  be  greatly  erroneous.  Moreover,  relative  comparisons  and  selections  of 
optimal  search  parameters  may  also  be  substantially  in  error,  although  this  may 
not  be  as  obvious.  The  purpose  of  the  report  is  to  provide  theoretical  tools  which 
can  be  used  to  avoid  such  erroneous  assumptions  of  independence. 

The  substance  of  this  report  is  largely  mathematical  in  character,  and  will 
be  presented  in  the  language  of  probability  theory.  To  find  this  report  usable,  the 
reader  will  need  facility  with  elementary  probability  theory,  and  will  need  some 
knowledge  of  stochastic  process  concepts.  In  particular,  an  understanding  of  the 
elementary  fundamentals  of  a  Markov  process  (or  Markov  chain)  will  be  necessary. 
Appendix  A  surveys  the  most  relevant  fundamentals,  with  emphasis  on  Markov 
processes,  but,  of  course,  it  is  not  a  substitute  for  a  text. 

it  is  useful  vo  bear  in  mind  that  the  problem  of  computing  cdp  is  equivalent  to 
the  problem  of  computing  the  distribution  of  the  maximum  of  a  sequence  of  random 
variables,  and  to  the  problem  of  computing  a  (cumulative)  multivariate  distribution. 
These  equivalences  assist  in  bringing  results  from  the  literature  to  bear  on  the 
cdp  problem,  and  may  in  turn  enable  cdp  research  to  contribute  to  these  equivalent 
problems.  It  is  surprising  how  little  is  known,  apparently,  about  computing  the 
multivariate  normal  distribution,  for  example. 

hi  the  remainder  of  this  introduction  we  review  the  historical  background  of  the 
cdp  problem,  and  relate  the  detection  problem  to  a  basic  mathematical  model: 
thresholding  on  a  stochastic  process.  Thereafter,  problems  of  detection  per  se 
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arise  only  in  abstraction.  The  four  succeeding  chapters  are  addressed  to  finding  cdp 
when  the  underlying  processes  are  respectively  two-state  Markov,  Gaussian,  "step," 
and  "step-plus-jitter."  The  appendices  survey  fundamentals  of  stochastic  processes, 
review  the  literature  on  multivariate  normal  distributions,  and  present  some  theorems 
on  correlation  which  are  useful  for  cdp  purposes. 


Background  of  the  Problem 

The  historical  background  of  the  problem  of  computing  cdp  stems  from  early  work 
on  search  theory,  envisioning  radar  and  sonar  detection,  notably  various  OEG  reports , 
and  derived  publications,by  B.  O.  Koopman.  We  particularly  cite  references  [b],  [cj, 
[d],  [e],  and  [f].  hi  general,  the  problem  of  computing  cdp  has  been  one  in  which  both 
empirical  knowledge  and  theoretical  tools  have  been  inadequate. 

The  first  three  of  these  references  are  addressed  to  general  theory  of  search, 
while  reference  [f]  is  an  analysis  of  sonar  data.  Among  other  things,  they  develop 
sweep  widths  as  areas  under  lateral  range  curves.  Each  point  on  a  lateral  range 
curve  is  a  c<h>,  viz. ,  the  probability  that  a  target  passing  at  given  lateral  range  will 
be  detected  at  some  point  during  the  pass  or,  alternatively,  at  some  point  prior  to 
reaching  closest  approach.  The  possibility  that  fluctuations  in  conditions  affecting 
detection  will  occur  during  a  pass  is  recognized,  but  is  generally  not  treated  explicitly 
in  references  [b],  [c],  [d],  and  [fj;  where  glimpses  are  accumulated,  they  are  done  on 
the  basis  of  glimpse-to-glimpse  independence,  hi  some  cases,  adjustment  is  made 
via  a  curve-fitting  parameter  (in  fitting  a  theoretical  model  to  empirical  data),  the 
adjustment  having  an  effect  of  partially  compensating  for  the  error  in  the  independence 
assumption. 

Reference  [e]  by  Koopman  is  a  theoretical  treatment  of  cumulative  success  in  a 
sequence  of  correlated  trials  —  the  basic  model  used  is  that  success-failure  as  a  two- 
state  process  is  .  a  Markov  chain  (Koopman  has  also  developed  this  model  in  greater 
depth  in  reference  [g],  among  other  papers).  Some  of  the  results  will  be  included 
here  for  completeness.  Moreover,  a  useful  approximation  akin  to  this  model  is 
presented  in  Chapter  m. 

More  recent  progress  in  theoretical  tools  has  been  offered  by  references  Pi] 
and  [i].  Reference  |h],  Appendix  B,  presented  a  model  for  time  fluctuations  of 
acoustics  in  sonar  detection  (presumed  to  be  primarily  propagation  loss)  known  as 
a  "(X,cr)-process. "  This  was  applied  to  cumulative  detection  and  approach  problems 
in  Appendix  C  of  the  same  reference  (these  Appendices  B  and  C  were  due  to 
J.  D.  Kettelle  Jr. ).  For  purposes  of  incorporating  detection  capability  in  cumulative 
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fashion  in  simulation  of  undersea  warfare,  APL  has  used  a  random  walk  model  described 
in  reference  [i].  This  is  a  special  type  of  Markov  chain  in  which  one  may  transition  only 
to  an  adjacent  state,  from  among  a  finite  set  of  states.  Evidently  sea  state  is  the 
fluctuating  parameter  primarily  envisioned.  Suitably  adapted  to  operational  data,  the 
models  of  references  [e] ,  (h],  and  [ij  could  be  useful  improvements  over  the  assumption 
of  independent  glimpses. 

More  recent  progress  has  also  been  made  in  empirical  knowledge  of  sequential 
correlation  effects  in  detection  parameters,  although  the  situation  still  leaves  a  great 
deal  to  be  desired.  References  0]  and  Pc]  are  careful  analyses  respectively  of  closely 
spaced  radar  observations  on  an  air  target  and  closely  spaced  sonar  propagation  losses 
in  convergence-zone  paths.  Reference  [a]  is  a  report  under  the  present  project  which 
presents  statistical  analyses  of  BRASS  n  sonar  data,  emphasizing  sequential  correlation 
behavior  in  bottom  loss  and  echo-to-reverberation  ratio.  Of  the  existing  gaps  in 
empirical  knowledge  of  the  sonar  aspects  of  the  problem,  human  operator  effects 
appear  to  be  by  far  the  most  important  (recognized  a  decade  ago  in  reference  [f]). 
However,  knowledge  of  correlation  behavior  in  propagation  loss  and  background  inter¬ 
ference  certainly  has  room  for  improvement;  in  particular,  there  are  no  known  data 
in  this  vein  on  direct-path  sonar  propagation  loss. 

It  is  the  aim  of  the  present  report  to  contribute  theoretical  tools  to  computation 
of  cdp.  The  methods  developed  are  motivated  largely  by  the  models  used  to  describe 
the  empirical  sonar  data  in  reference  [a].  In  reference  (a]  it  was  inferred  that  under 
certain  circumstances,  the  signal  process  could  be  of  a  Gaussian  nature  and  in  other 
circumstances  ’’step-plus-jitter.  ”  The  step-plus-jitter  process  has  as  a  special  case 
a  step  process,  of  which  the  (A,o)-process  mentioned  above  is  an  example.  From 
this  derives  the  interest  in  the  types  of  processes  treated  in  Chapters  m,  IV,  and  V. 

We  note  again  that  reference  [a]  does  not  include  operator  effects  — when  these  are 
included,  the  signal  process  is  highly  conjectural,  and  the  simpler  two-state  Markov 
processes  considered  in  Chapter  H  may  be  as  plausible  as  the  others. 


Stochastic  Process  Model  for  cdp 

We  suppose  that  a  target  is  moving  on  an  arbitrary  track  relative  to  a  sensor 
device  being  used  to  detect  the  target.  The  sensor  operates  in  discrete  glimpses. 
The  separation  between  glimpses  could  arise,  for  example,  from  the  fact  that  the 
sensor  is  an  active  sonar  and  must  wait  for  sound  travel  between  pings,  or  from 
the  sensor  being  either  a  sonar  or  a  radar  transmitting  directionally  in  sweeps, 
illuminating  the  target  at  most  once  each  sweep.  Passive  sonar  detect! cm  would  lead 
to  a  somewhat  different  model  (glimpses  would  be  overlapping  time  ’’windows"),  but 
it  is  possible  that  results  in  terms  of  discrete  glimpses  as  developed  herein  might 
also  be  useful  in  passive  problems. 
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The  outcome  of  the  i&  glimpse  is  a  random  variable  Xu  regarded  as  signal  and 
often  measured  in  decibels.  This  random  variable  may  take  on  values  from  a 
continuum  of  real  numbers  and  possesses  a  probability  distribution  over  these  values. 
The  sequence  of  glimpses  thus  gives  rise  to  a  sequence  (Xj.,  X2,  . . . )  of  random 
variables,  and  this  sequence  is  termed  a  "stochastic  process"  with  a  "discrete 
parameter. "  This  term  is  defined  more  explicitly  in  Appendix  A  (and  more  generally 
and  abstractly  in  textbooks  referenced  there). 

It  is  convenient  to  consider  that  .more  generally,  a  glimpse  is  potentially 
available  to  the  sensor  at  any  time  and  to  denote  by  X  ^  the  signal  random  variable 
which  would  result  from  a  glimpse  at  time  t.  This  determines  a  stochastic 
process  X*  with  "continuous  parameter";  the  process  associates  with  each  non¬ 
negative  number  t,  a  random  variable  X*.  In  practice,  X*  will  be  sampled  at 
discrete  times  tj,,. . .  ,t^,  giving  rise  to  a  discrete -parameter  process  (X^, . . .  .X^), 
of  the  sort  mentioned  in  the  preceding  paragraph,  which  we  denote  (Xj_, . . .  ,Xjj)  for 
brevity.  In  the  body  of  the  report,  asterisks  will  distinguish  continuous-parameter 
terminology  from  discrete-parameter  terminology  —  we  usually  deal  with  the  latter, 
hi  the  appendices,  this  distinction  will  not  be  made. 

One  usually  thinks  of  the  parameter  of  the  signal  process  X  as  being  time 
(usually  denoted  t),  although  it  could  just  as  well  be  distance.  This  matter  does 
not  concern  us  in  the  present  report.  We  note  that  in  the  stochastic  process 
inferences  from  empirical  data  in  reference  [a],  one  could  not  discern  from  the 
data  whether  the  processes  were  time-dependent  or  distance-dependent. 

To  relate  the  signal  random  variable  to  detection,  we  introduce  a  detection 
threshold  function  T*.  If  X*  is  sampled  (observed)  at  the  point  t,  then  detection 
ensues  if  and  only  if  the  sampled  value  of  X*  exceeds  T*.  This  gives  rise  to  a 
new,  two-state,  process  D*  which  is  called  the  success-failure  process: 


if  X*  < 


if  X*  >  T* 


sic  jjc 

A  success  (detection)  occurs  whenever  D*=l,  and  a  failure  occurs  whenever  D^=0. 
We  define  p^,  the  single -trial  success  (detection)  probability  (also  called 
unconditional  success  probability)  for  a  trial  (glimpse)  at  the  point  t,  by 


p*  =  Pr{D*  =  l  } 

=  Pr  {  X*  >  T*}  . 
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l***/-’3M** 


(The  operator  Pr  is  road,  "the  probability  of  the  event. ") 

Suppose  again  that  the  continuous-parameter  process  X*  is  sampled  at  tj_, . . .  ,tn. 
Then  we  denote  T^,  Dt  ,  and  pt  by  Tj,  Dj,  and  pj  respectively  for  i  =  1, . . .  ,n.  We 
now  define  Pn.  the  cumulative  detection  probability  (abbreviated  "cdp")  in  the  n  trials 
by 


Pn  =  Pr  {  Dj  =  1  for  some  i,  1  <  i  <  n} 


=  Pr  {  Xj  >  Tj  for  some  i,  1 1  i  -  n} 


Computing  Pn  is  the  problem  to  which  this  report  is  addressed.  In  two  cases. 
Theorems  II- 1  and  IV-2,  we  will  treat  an  extension  of  Pn  applying  directly  to  the 
continuous -parameter  process  X*;  this  cdp  is,  for  a  given  interval  [0,  u]. 


P&  =  Pr  {  X^  >  T*  for  some  t,  0  <  1 1  u } 


=  1  -  Pr{  sup  (Xt-Tt)<0>. 
Oitiu 


There  is  a  certain  amount  of  arbitrariness  in  setting  the  detection  threshold 
function  T*  — different  thresholds  might  be  used  for  different  reference  levels  in 
the  signal  process  X*,  and  the  reference  levels  need  r:ot  be  constant.  The  most 
convenient  choice  in  this  regard  would  be  to  incorporate  into  T*  the  deterministic 
(i.  e. ,  systematic)  variations  during  an  encounter,  while  X*  reflects  Ihe  random 
variations  about  a  constant  mean,  i.  e. ,  ihe  mean  of  the  random  variable  X*  is  the 
same  for  all  t.  Li  this  case,  it  is  plausible  that  the  process  X*  will  be  "stationary" 
in  Ihe  sense  defined  in  Appendix  A,  in  addition  to  having  a  stationary  mean. 

As  an  example  of  variability  in  thresholds,  suppose  the  target  is  passing  on  a 
straight  track  with  a  stated  closest  approach  to  the  sensor.  During  the  sequence 
of  glimpses,  the  range  will  decrease  monotonically,  will  reach  a  minimum,  and 
then  will  increase  monotonically  thereafter.  Suppose  that  parameters  other  than 
range  (e.  g. ,  environmental  and  operator  effects)  which  affect  detection  have  the 
same  statistical  behavior  on  each  glimpse,  on  each  pair  of  consecutive  glimpses,  etc. 
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These  effects  other  than  range  can  be  conveniently  reflected  in  a  stationary  stochastic 
process  X*,  while  the  deterministic  effects  of  range  are  reflected  in  the  detection 
threshold  T*,  decreasing  with  range.  This  example  has  a  particular  type  of 
threshold  variation  which  is  useful  in  Chapter  IV:  the  detection  function  is  referred 
to  as  "unimodal"  (although  it  is  actually  the  single-trial  success  probability  p  ^  which 
increases  to  a  maximum  and  decreases  thereafter).  Another  example  of  systematic 
effect  on  detection,  for  some  detection  systems,  is  the  effect  of  target  aspect 
(plausibly  again  unimodal). 

Throughout  the  body  of  the  report,  we  fix  a  continuous-parameter  stochastic 
process  X*,  a  threshold  function  T*,  a  single -trial  success  probability  function  p*. 
and  the  associated  two-state  success-failure  process  IT,  all  as  defined  in  general 
terms  above.  In  Chapters  DDE,  IV,  and  V,  the  process  X*  is  specialized  to  be 
respectively  Gaussian,  "step,"  and  "step-plus-jitter, "  to  be  defined  later. 

Chapter  n  does  not  deal  with  X*  explicitly,  but  assumes  that  the  two-state  process  D* 
is  Markovian.  In  all  cases,  X*  is  sampled  (i.e. ,  observed  or  trials  are  made)  at 
tl>  •  •  •  »tn>  giving  rise  to  the  discrete -parameter  quantities  Xj,  Ti}  Dj,  and  pj,  for 
i  =  1, . . .  ,n.  The  central  problem  is  to  find  the  corresponding  Pn. 

We  note  two  conventions:  If  q  is  a  probability,  then  1  -  q  will  be  denoted  by  q. 

The  end  of  a  proof  is  marked:  ##### 
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CHAPTER  II 


TWO-STATE  MARKOV  PROCESSES 


In  this  chapter  we  assume  that  D*,  the  success-failure  process  being  sampled,  is 
a  two-state  Markov  process,  and  we  present  formulas  for  cdp  in  this  case.  In  practice, 
the  two-state  nature  of  the  process  would  presumably  arise  by  thresholding  on  a  multi- 
state  process  X*,  as  described  in  Chapter  I.  However,  the  source  of  the  two-state 
process  does  not  concern  us  in  this  chapter. 

A  two-state  Markov  process  is  possibly  the  simplest  type  of  non-independent 
process,  for  cdp  purposes.  For  this  reason,  it  will  be  a  convenient  type  of  an 
assumption  in  practical  applications.  Moreover,  the  principal  technique  given  in 
Chapter  IH  for  computing  cdp  in  Gaussian  processes,  will  be  an  approximation  which 
is  closely  related  to  cdp  in  two-state  Markov  processes. 

In  this  chapter,  we  will  be  able  to  give  formulas  for  the  probability  of  at  least  k 
successes,  and  exactly  k  successes,  in  n  trials.  Elsewhere  in  the  report,  we  are 
restricted  to  k=  1. 

The  first  section,  which  contains  most  of  the  discussion,  is  addressed  to  the 
stationary  case,  wherein  the  single -trial  probability  of  success  is  constant.  The 
non-stationary  case  is  discussed  briefly  in  the  second  section.  Limiting  values  of 
cdp,  as  the  number  of  trials  in  a  given  interval  becomes  infinite ,  are  given  in  the 
third  section.  The  final  section  reviews  independent  processes  which  may  be 
regarded  as  a  special  case  of  Markov  processes. 

Most  of  the  results  of  this  chapter  are  taken  from  Koopman,  reference  [e], 
and  Thiess,  reference  [1].  Theorems  H-l  and  H-2  were  supplied  by  our  colleague, 

D.  C.  Bossard. 


Stationary  Two-State  Markov  Processes 

hi  this  section  we  investigate  the  simplest  type  of  two-state  Markov  process,  in 
which  p,  the  single-trial  probability  of  success,  does  not  change  from  trial  to  trial. 
Correlation  between  successive  trials  also  does  not  change.  This  is  a  stationary 
process.  (See  Appendix  A  for  definitions  of  these  terms. ) 


The  process  in  this  case  is  characterized  by  a  matrix  of  four  transition  prob¬ 
abilities  given  as  follows,  each  entry  being  the  probability  that  if  the  trial 
results  in  the  state  of  the  row  heading,  then  the  j  +  Is*  trial  results  in  the  column 
heading: 


Success  Failure 


Success 


a 


a 


Failure 


b 


<n-i) 


The  assumption  that  the  process  is  Markovian  means  simply,  by  definition,  that 
these  probabilities  do  not  depend  on  outcomes  of  trials  prior  to  the  j**1  trial.  The 
assumption  of  stationarity  means  simply  that  these  probabilities  are  independent  of  j. 
Processes  of  this  type,  as  well  as  non-stationary  cases,  are  explored  in  detail  by 
Koopman  in  references  [e]  and  [g].  Additional  discussion  of  Markov  processes  is 
given  in  Appendix  A. 

Let  r  be  the  correlation  coefficient  (see  Appendix  A  and  Theorem  C-2  of 
Appendix  C)  between  successive  trials,  and  p  be  the  probability  that  k  random 
trial  results  in  success.  We  then  have  (reference  [e]): 


r  =  a  -  b 
a  =  p  +  p  r 
b  =  p  -  p  r. 


We  thus  see  that  p  and  r  suffice  to  describe  the  situation;  note,  however,  that  we 
must  have  r  t  -p/p  and  r  >  -p/p,  since  a  and  b  are  probabilities.  The  correlation 
coefficient  between  trials  h  units  apart  is  r*1. 

Let  Rn^)  be  the  probability  of  exactly  k  successes  in  n  trials.  Let  Pn^  be 
the  probability  of  at  least  k  successes  in  n  trials  — we  are  primarily  interested 
in  k=  l,and  k=  1  will  be  understood  if  the  superscript  is  omitted.  Then  is 
the  probability  of  n  consecutive  failures: 


b/O  =  p  b  "-1. 
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For  k^O,  is  given  by  {see  Thiess,  reference  [1]): 


RnW=  V  vmW  i  b  n'm'1  +  V  00  , 
'n  m=k  m  n 


where  the  vm^)  *s  are  found  from 


bx+p(l-x)  .  ,  abx2vk_i  “ 

x - - - —  (ax  + =—  )K  1  =  2  v 

1-bx  1-bx  m=k  m 


(H-2) 


The  left  member  as  a  function  of  x  is  a  "generating  function"  for  the  probabilities 
Rnfc).  Koopman  gives  an  alternative  generating  function  formulation  as  formula  (20), 
Section  5,  of  reference  [ej.  Formula  (II— 2)  is  slightly  more  general  than  the 
corresponding  expression  in  reference  [1],  since  it  allows  for  a  probability  of  p  that 
the  first  event  will  be  a  success  rather  than  requiring  that  the  first  event  be  a  failure. 
We  quote  the  results  for  k=  0  and  k=  I: 


R^0)  =  pb 


n-1 


%(!)  =  pabn~2  +  (n-2)  pabbn~3  +  pbbn"2. 


From  these  we  can  calculate  the  PnW  and  Pn^2^: 


Pn(1)  -  1  ”  Rn(0) 

(H-3) 

Pn<2)  =  1  -  R^0)  -  R^1). 


We  can  also  express  these  probabilities  in  terms  of  r: 


H11<0)  =  p  (p+pr)11'1 

Rn<1)  =  pp  (1-r)  (p+pr)n“3  (2r  +  np  (1-r)). 


If  r=0,  then  R^k)  reduces  to  the  familiar  binomial  form  (see  last  section). 

Reference  [1  ]  also  gives  the  probability  S,^2)  of  receiving  two  consecutive 
successes  under  the  same  conditions  as  above: 


Sn(2)  =  pa  +  p(l 


|n-i  (|+b)_£h-l  (£+b)v 

I  -  t  h 


where 


£  = 
I  = 


-j  (b  -  ^b2  +  4ab) 


1 


—  (b  +  ^b4  +  4ab). 


Figures  EE-1  (p  =  0.  3),  II-2  (p  =  0.  5)  and  II*r3  (p  =  0.  8)  give  the  probabilities  P^1) 
and  Pn(2)  for  n=2,  3,  4,  and  5.  In  Figure  H— 1,  S4(2)  is  shown  by  a  dashed  line;  of 
course,  S2^2)  =  P2^>  s. 


We  note  from  Figure  II-l  that  the  effect  of  correlation  increases  with  the  number 
of  trials  (as  expected)  and  that  it  increases  as  the  unconditional  probability,  p, 
decreases.  The  effect  on  the  probability  P^O-)  of  at  least  one  success  in  4  trials  is 
opposite  to  the  effect  on  P^2)  and  S^2),  where  at  least  two  and  at  least  two 
successive  detections  are  respectively  required;  the  former  probability  decreases 
as  r  increases,  while  the  latter  probabilities  generally  increase,  reaching  a 
maximum  for  r  <  1  in  some  cases. 


The  effect  of  correlation  on  Pn  =  Pn(1)  is  shown  in  a  different  form  in 
Figures  n-4,  II-5,  and  n-6.  For  various  values  of  p,  the  number  of  trials  required 
to  yield  various  levels  of  Pn  versus  the  correlation  coefficient  r  is  plotted.  One 
notes  that  the  number  of  trials  required  increases  monotonically  with  r,  the  increase 
becoming  very  rapid  as  r  approaches  unity. 


o 


Success -Failure  Correlation  Coefficient  r 


Success-Failure  Correlation  Coefficient  r 


NUMBER  OF  TRIALS  RE 


■a  mss& 


Non-Stationary  Two-State  Markov  Processes 


In  the  non-stationary  case,  the  quantities  a,  b,-  p,  and  r  are  permitted  to  change 
from  trial  to  trial,  and  are  subscripted  by  the  trial  number  accordingly.  One 
generalization  is  that  the  correlation  coefficient  between  the  jtb  trial  and  the 
(j  +h)th  trial  is 


j+h-1 

n 

i=j 


y 


where  rj  is  the  correlation  between  the  i^1  and  (i  +  l)st  trial. 

The  transition  probabilities  on  the  j^1  trial  are  given  by  (page  5,  reference  [e]): 


and 


WrJpM 


1 


Vl 


pj-i  pj-i 


bi  =  Pi  “  ri  P4 


'j  n 


pjpi 


pmpm 


(n-4) 


The  cdp  is  given  by 


Pn  =  Pn(D  =  1  -  p, 


n  _ 

i  n  bi. 
1  j=2  J 


(n-5) 


We  shall  make  use  of  formula  (11-5)  in  devising  an  approximation  to  cdp  in  a 
Gaussian  process  in  Chapter  m. 

Reference  [e]  gives  difference  equations  for  the  probability  of  exactly  k  successes 
in  n  trials  in  this  non-stationary  case. 
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Continuous-Parameter  Two-State  Markov  Processes 


In  practice  we  customarily  achieve  a  sequence  of  trials,  described  previously  as 
a  two-state  Markov  process,  by  sequentially  sampling  a  continuous  process.  (The 
discrete-parameter  process  is  usually  called  a  Markov  chain. )  We  now  state  some 
elementary  facts  regarding  the  continuous  version  of  the  process,  confining  attention 
to  the  stationary  case.  For  present  purposes,  we  define  a  continuous-parameter 
two-state  process  D  to  be  stationary  Markov  if  every  discrete-parameter  process 
obtained  by  sampling  D  at  uniform  points  is  stationary  Markov. 

It  has  been  noted  that  the  correlation  between  trials  separated  by  h  is  r*1, 
where  r  is  the  correlation  between  successive  trials.  The  corresponding  statement 
in  a  continuous-parameter  process  is  that  the  autocorrelation  function  associated 
with  the  process  is  of  the  form  e"*-*1,  for  gome  fixed  \  >  0. 

Suppose  that  D  is  a  continuous  stationary  two-state  Markov  process,  and  p  is  the 
unconditional  probability  of  success.  Let  X  >  0  be  as  above.  Suppose  that  D  is 
sampled  at  the  n+1  points,  it/n  for  i  =  0, . . .  ,n,  uniformly  spaced  in  the  interval 
[0,t].  Then  the  limiting  value  of  Pn  is  given  by  the  following  theorem: 

Theorem  n-1.  Under  the  above  conditions, 


Pao=tim  P^l-pe^P*. 

n-*oo 

Proof.  From  formula  (H— 3)  and  the  given  autocorrelation  function,  we  have 


1  -  Pn  =  p  [p+pe'^J11'1. 


The  proof  is  completed  by  letting  n  approach  infinity.  * 


MlL-tl-tl-U- 

WfflHHr 


*  Throughout  the  report,  the  end  of  a  proof  will  be  denoted  by:  #####. 
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Theorem  n-1  is  a  special  case  of  a  more  general  result  given  in  Chapter  IV  as 
Theorem  IV-2. 

A  comparison  of  this  limiting  case,  i.  e. ,  when  the  number  of  trials  approaches 
infinity,  with  cases  for  a  finite  number  of  trials  is  illustrated  in  Figure  H-7.  One 
notes  that  in  general,  with  10  or  more  trials,  cdp  is  not  much  smaller  than  the 
limiting  cdp  (n=»  ),  and  hence  this  formula  for  the  limiting  cdp  may  be  a  useful 
approximation  when  the  number  of  trials  is  fairly  large. 

A  different  type  of  limiting  situation  is  treated  by  Koopman  in  reference  [g]: 
the  sequence  of  trial  sequences  is  not  contained  in  a  fixed  interval.  Under  various 
conditions  on  limits,  generating  functions  and  explicit  formulas  are  developed  for 
the  probability  of  exactly  k  successes  in  the  limiting  case. 


Independent  Processes 

We  conclude  this  chapter  with  a  brief  discussion  of  independent  processes 
(which  may  be  regarded  as  a  special  type  of  Markov  process). 

A  stochastic  process  X  is  independent  if  Xj  and  Xj  are  independent  random 
variables  whenever  ir  j.  Since  there  are  no  correlation  problems  in  independent 
processes,  there  is  no  loss  of  generality,  for  cdp  purposes,  in  confining  attention 
to  two-state  success -failure  versions  of  independent  processes,  i.e. ,  the  D  process 
in  the  notation  of  Chapter  I.  A  two-state  Markov  process  specializes  to  one  of  this 
type  if  aj  =  bj  in  formulas  (H-4). 

Let  pj  be  the  unconditional  probability  of  success  in  the  i^1  trial  of  an 
independent  process,  for  i= 1, . . .  ,n.  Let  Pnfa)  be  the  probability  of  at  least 
k  successes  in  the  n  trials,  and  let  Rn(k)  be  the  probability  of  exactly  k  successes. 
Then 


-p„(1)=  .ni(i-pi)  =  Bn(°). 


<n-6> 


KPi=P0for  i  =  1»- 


and 


,n,  then 


i-pn(l)=(i-Po)n 

Rj,(k) .  pk  (!  -po>n-k 

* 

Pn(k>=  jL*»0)--1- 


(n-7 

<n) 

(n-8) 

k-1 

S  Rn<J>. 

3=0  * 

<n-9) 
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FIGURE  II-7 


EFFECT  OF  NUMBER  OF  TRIALS  ON  -TWO-STATE  MARKOV  cud 


p=0. 3 


1 


Assumptions: 

Success -failure  process  is  stationary 

Markov 

p  =  unconditional  probability  of 
success  (constant) 

n  =  number  of  trials  in  interval  [o,t] 

3?n  =  probability  of  at  least  one  success 

in  n  trials 

e  A  =  autocorrelation  between  trials 
separated  by  h 


Formulas  (11-6)  through  (D>9)  are  well-known;  formulas  (II-8)  and  (H-9)  are  tabulated 
in  reference  {m].  Formulas  (II-6)  and  (31-7)  are  often  applied  erroneously  (when  the 
process  is  not  independent),  which  is  the  motivation  for  this  report. 

The  following  theorem  provides  a  means  of  finding  R^)  in  general: 

Theorem  H-2.  With  pp . . .  ,pn  and  1^0*0  defined  as  above,  we  have 


k 

"  iTAn<Pl’ 


,Pn,  t) 


t=l  fork=0’ 


n, 


where 


n 


An  ^  P i  ’ '  *  *  ’  Pn  >  (1  ~  P j  » 

An  may  be  thought  of  as  a  generating  function  for  R^). 

Proof.  We  have  the  following  recursive  equation,  writing  38  Rn^  (Pp  •  •  •  >Pn): 

<Pi . Pn>=r  Jj  Pi  RhS"1)  Pi+1 . Pn>- 

It  is  also  easily  shown  that 


(-l)k  9  k  (-i)h  n  9 k_1 

k;  TIT  An(P].»*  •  •  »Pn’ =  "kl  £“[“  An-l<Pl»  *  *  *  ’pi-l’pi+r  *  •  *  »pn’ *  ^“pi^ 


9 1 


9 1 


1  n.  (-l)k-1  9k_1 

-  k  iSi  pi  ‘  imr  77F  An-l(pl . pi-l,pi+l’  •  •  •  ,pn't)' 

o  t 
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so  that 


(-i)k  ak  . 

k»  k 
*  3t 


satisfies  the  same  recursive  equation  as  R^k). 
Now,  since 


n 

•  .Pn)  =  n  (1-p.)  = 


-Pn.t) 


and 


,P 


n 


n 

)=  2 


pi 


i=i  (i-Pj) 


n 

n  (i-p.) 

j~i  J 


^_1^9t  An^V 


•  •  »Pn> t)! 


the  theorem  follows  by  induction  on  k+n. 


##### 


We  illustrate  Theorem  Ii-2  by  application  to  k=l,  2,  3.  We  have 


log  An  =  2  log  (1-p.t) 


9  A 

— -  =  A  2  ■■■■■■ 

3  t  n  1  -p.  t 
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2 


3 1 2 


(1  -p.t) 2 


s_£i_.2i^2_Pii_.AnSjpi!_. 

at3  at2  i-p.t  3 1  (i-p.t)2  (i-p.t)3 

Therefore,  by  Theorem  n-2,  letting  a>.  =  p^/p.  for  i  =  l, . . .  ,n, 

Rn(0)  =  n  ,1 

Rjj*1*  =  n  pj  •  s  «, 

Rn(2,=  np.  •  {(zu.)2  -  !».*) 

H„<3,=  |np.-  {3(S«j)  (2  u,2)  -  (2  Uj)3  +  2  S  U);3}  . 

These  suffice  to  give  Pn(k)  for  k=  1, . . .  ,4. 


CHAPTER  III 


GAUSSIAN  PROCESSES 


In  this  chapter  we  assume  that  the  underlying  continuous-parameter  process  X*  is 
Gaussian.  By  this  is  meant  simply  that  the  joint  distribution  of  any  sequence  of  observa 
tion  of  random  variables  (Xj, . . .  .Xjj  )  is  multivariate  normal  (see  Appendix  A). 

In  view  of  the  definition  of  a  Gaussian  process,  the  problem  of  computing  cdp, 


Pn  =  l-Pr{XjS  . X„<  Tn}, 


is  equivalent  to  evaluating  the  multivariate  normal  distribution.  For  this  reason,  we  have 
included  in  Appendix  B,a  survey  of  the  literature  on  computing  this  distribution. 

The  main  method  of  this  chapter  is  a  convenient  approximation  described  in  the  first 
section,  with  computation  aids  in  Figures  m-1  through  ID-4.  The  computation  method  is 
illustrated  by  an  example.  The  approximation  is  based  on  the  assumption  that  the  success 
failure  process  D  is  Markovian.  The  error  introduced  by  this  assumption  is  investigated 
in  the  second  section ;  insofar  as  it  has  been  tested  (for  n=3  and  n  =  5  trials  —  in  Table 
m-1),  the  approximation  is  very  accurate,  providing  the  discrete-parameter  observation 
process  X  is  Markovian  (also  true  if  X*  is  Markovian) .  The  approximation  is  less 
accurate  in  some  special  cases  where  X  is  not  Markovian. 


Approximation  Method 

Our  principal  method  for  computing  cdp,  Pn,  in  a  Gaussian  process  will  be  an 
approximation  method  presented  in  this  section.  The  method  is  based  on  the  assumption 
that  the  success-failure  process  D  is  Markovian.  It  is  intended  that  this  approximation 
be  primarily  used  when  X  is  Markovian  —  it  docs  not  follow  that  D  is  Markovian  (e.  g. 
see  Rosenblatt,  reference  [n] ) ,  which  is  the  source  cf  error  in  the  approximation. 
Errors  in  PR  will  be  investigated  in  the  next  section. 


I 
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Under  the  assumption  that  D  is  Markovian,  Pn  is  given  by  formula  (II-5)  of  Chapter 
II: 


Pn  =Pl  J2  *1  • 


where  bj  is  the  probability  that  the  i^1  trial  fails,  given  failure  on  the  (i-l)st  trial;  as 
before,  p^  is  the  probability  of  success  on  the  i^  trial. 

Define  z.  to  be  the  probability  that  both  the  i**1  and  (i-l)st  trials  fail,  for 

i  =  2 . n.  1’hen  by  definition  of  conditional  probability  (or  by  applying  formula  (II -4) 

of  Chapter  n  and  Theorem  C-2(ii)  of  Appendix  C), 


zi,i-l 

Pi-1 


The  formula  for  PQ  can  thus  be  written: 


n 

=  n  Pi 
i=l  1 


n 

n 

i=2 


z_. 


hi:} 

^  Pi-i 


n 

=  n 

i=l 


n 

n 

i=2 


Yi,i-1  * 


(HI-1) 


where 


* i,i“l 


ZU-1 

Pi  Pi-1 
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Note  that  the  product  of  the  y .  .  -  !s  represents  a  multiplicative  correction  to  the  value 
of  Pn  which  would  be  obtained:  in  the  presence  of  independent  trials.  For  this  reason, 
we  will  refer  to  y.  ^  as  a  correction  factor;  the  double  subscript  refers  to  the  fact 
that  it  depends  on  b’ehavior  in  both  the  it“  and  (i-1) s*  trials. 

The  Gaussian  nature  of  X  has  nothing  to  do  with  formula  (HI-1).  However,  assuming, 
as  we  do,  that  X  is  Gaussian,  z.  is  conveniently  obtained  from  the  bivariate  normal 
tables,  reference  [pj.  Using  these  tables,  curves  have  been  prepared  for  computational 
convenience,  and  presented  as  Figures  m-1  through  in -4,  giving  log  y.  .  .  The 

inputs  to  these  curves  pertain  to  the  multi-state  process  X  rather  than  the’  Iwo-state 
process  D: 

(1)  Thresholds  T.  and  T^_^  measured  in  standard  deviations  from  the  means  of 
X.  and  X._j  .  The  thresholds  are  separately  used  to  determine  p.  and  p^_^ . 

(2)  The  correlation  p.  between  X.  and  X.  .  This  is  not  the  same  as  the 
correlation  r^lum  needed) between  Dj  and  ,  as  shown  by  Theorem  C-3 
of  Appendix  C. 

Separate  curves  have  been  prepared  for  p.  i_1  =  .  3,  .5,  .7,  .  9  .  At  the  end  points 


=  0 


when  p.  =  0 
*  * 


and 


-log1()  max  {p. ,  p._x  }  when  p. 


1  . 


Linear  interpolation  of  log1Q  y^  with  respect  to  pj  is  quite  accurate.  The  figures 
are  symmetric  in  T.  and  TT_^  .  * 


Example;  We  give  an  example  to  illustrate  the  procedure.  Let  X*  be  a  stationary 
Markov  (Gaussian)  process  with  common  mean  zero,  common  standard  deviation  of  5  db, 
and  autocorrelation  between  any  x£  and  X^ 


-.  69 

a  (*2  ~  ty  =  e 


* 
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i,  e. ,  correlation  is  0. 5  between  variables  one  time  unit  apart.  Let  X*  be  sampled  at 
times  tj  =  0,  t2  =  2,  tg  =  3,  and  t^=  5,  i.  e. ,  four  non-uniformly  spaced  trials.  The 
process  (Xp . . .  .X^  =  (X^  , . . .  ,X£  )  is  also  Markovian,  but  is  not  stationary  since 


=  a(t2-tj)  =  .52/.5  =  /j; 


(It  can  be  shown  that  the  corresponding  (Dp  . . . ,  )  is  not  Markovian,  which  is  what 

makes  the  method  only  approximate.)  Let  the  detection  thresholds  (in  db)  be  6. 5,  2. 5, 
0,  and  4.0  respectively. 

The  following  table  shows  in  tabular  form  all  the  steps  necessary  to  calculate  Pn 
in  this  situation: 


Trial  index  i 

,„1 

,2 

,  „  3 

.  .  4 

Trial  time  tj 

0 

2 

3 

5 

Threshold 

T(in  o’s  from  mean) 

1.3 

.5 

.0 

.8 

Single-trial  failure 
probability  p. 

.9032 

.6915 

.5000 

.7881 

Correlation  p.  .  . 

.25 

.50 

.25 

log10yi,i-l 

.011 

.083 

.030 

loglO  Pi 

. 956-1 

.840-1 

. 699-1 

.897-1 

Then  log1Q  Pn  is  the  sum  of  the  bottom  two  rows,  i.  e. 
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log10  Pn  =  3*516"4  =  *516-1 
Pn  =  ,  328  . 

If  one  assumed  the  trials  were  independent,  then  one  would  obtain 

loglO  Pn  =  .392-1 
Pn  =  .  247  . 


Error  Estimates 

In  this  section  we  investigate  the  error  in  the  approximation  method  of  the  pre¬ 
ceding  section.  The  error  is  introduced  by  the  assumption  that  the  success-failure 
process  D  is  Markovian.  For  this  purpose  we  assume  that  the  discrete-parameter 
Gaussian  process  X  is  Markovian.  When  this  condition  is  not  satisfied,  no  information 
has  been  obtained  on  error  estimates,  except  for  the  very  special  case  of  formula  (A-4) 
of  Appendix  A.  Even  in  the  Markov  case  our  error  estimates  are  restricted  primarily 
to  the  case  where  n=3  or  5  trials.  General  statements  relevant  to  these  error  estimates 
are  embodied  in  the  three  theorems  below.  At  the  conclusion  of  the  theorems  numerical 
examples  are  given  in  Table  ni-1. 

Theorem  HI-1.  Let  (Xp  X2,  Xg)  be  a  Gaussian  Markov  process  and  assume  p.  =  0 
and  tr .  =  1  for  i  =  1, 2, 3.  let  p..  for  i  be  the  value  of  the  correlation  between  the  random 
variables  X.  and  Xj ,  and  assume  that  0  <  p^  <  1.  Then 


P3  =  Pr{  Xj  -  Tj  and  Xg  -  Tg  and  Xg  *  Tg} 


.  ,Ti  -»%. 

21 
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I 


where  $  is  the  standard  normal  distribution  function  (see  Appendix  A) . 
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given  that  X.  =u,is  simply  normal  with  mean  up^  and  variance  1  ••  & .  .  By  hypothesis 
(X1,  X2,  Xg)  is  Gaussian  Markov,  and  thereforeJ  Xj  and  X3  will  be  independent,  given 
a  particular  value  for  Xg.  Thus 


= 


=  /  Pr{  X.  <  T.,  for  i  =  l,3  j  X^u' 


—00 


=  /  Pr{Xx<  Tx  I  X2=u}  •  Pr{X3<  T3  |  X2=u}d*(u) 


-00 


2  T«  ~  Up  n i  T«  -  upqo 

=  /  *<7=====r)  ^ d»(u)  .  ##### 


i  i-p|x  /  i-P? 
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The  same  method  can  be  used  in  more  general,  fashion,  e.  g.  if  (X^, . . . ,  Xg )  is 
Gaussian  Markov,  then 


3  , 

P  =  Pr  {  X.  <  T.  for  1  <  i  <  5  }  =  /  Pr  {  X  <  T  and  X  <  T  |  X  =  u} 

O  11  _0Q  11  6  6  0 


(ni-2) 


•Pr{X4<  T4  and X&  -  Tg  |  X3=u}d*(u)  . 


Since  the  conditional  distributions  in  the  integrand  are  bivariate  normal,  one  has  a 
more  difficult  time  in  carrying  out  the  numerical  integration;  however  the  bivariate 
normal  distribution  is  tabulated  in  reference  [p]  . 

Theorem  III -2.  Let  (X-,  X*.  Xg),  p. ,  o^  ,  p  and  Pg  be  aa  in  Theorem  HI-1. 
Let  Pg  be  the  approximate  cap  obtained  by  assuming  the  success-failure  process  to 
be  Markovian  (formula  HI-1).  Then  the  error  in  cdp  is 
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Tn  T, 


P„  -  P„  = 


3  3  *(T2)  ' 


1  l2  2  T-  -  up2  Tq  -  upu„  T„  -  vp* 

^ -.  /  /  «(  ,1 - l1)  [  »(  ,?  -  i(li^=M))6HM)  dt(v) 


'VT^T '  ‘  VT^7 

^32  r  P32 


an~3) 


and 


P  -  P 
3  3 


Proof.  Under  the  Markov  assumption  on  (D^,  D^,  Dg),  the  success-failure  process, 


1  -  Pg  =  Pr  {  Dx  =  D2  =  D3  =  0  } 


=  Pr  {D1=0  |  D2  =  0}  Pr{D3=0  |  D2  =  0}  Pr{D2  =  o} 


=  Pr { x2  -  T2 }  Pv{X1<T1  |  X2<T2}  Pr{X3<Tg  |  Xg  <  Tg} 
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Using  Theorem  III-l,  we  have 
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^32 


Equation  (III -3)  followb  from  (III— 4)  and  (in-5\.  It  remains  to  show  that  -  P  .  If 
we  denote  the  factor  in  square  brackets  in  the  right-hand  side  of  (HI-3)  byB(u,v), 
then  clearly  B(u,v)  =  -B(v,u)  >  0  for  v  >  u.  Since  the  product  measure  of  $  itself  is 
symmetric  about  the  line  v  =u, 


—00 


)]  B(u,v)d#(u)  d$(v). 


(Ill -6) 


But  this  integration  is  over  the  region  where  v  -  u, and  hi  this  case  both  factors  in  the 

integrand  of  formula  (HI-6)  are  non-negative.  Hence  P  £  P  .  ##### 

3  3 

We  now  turn  to  the  problem  of  obtaining  an  upper  bound  on  the  error  P,  -  P„ 
in  Theorem  III -2. 


Theorem  HI -3.  Assume  the  hypothesis  ami  notation  of  Theorem  HI-2  and  also 
that  the  detection  thresholds  are  constant,  i.  e.  Tj  =  TQ .  Then 


P  -  P 
3  3 
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P,  -P3  5  *(T0)  forTo<0. 
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Proof.  Let  TQ  -  0.  Then  (T^  £  and  hence  l/$ (Tq)  $  2.  When  v-uwe  obtain, 
by  the  Mean  Value  Theorem, 


where  x  is  some  number  such  that 


If  -«o  5  v  -  T  ,  then  the  smallest  value  that  x  may  assume  is 
o 


To  ~  To^ij  _  To  ^  _  V1  ~^ij 

■/  i  -  p?.  i/~7~-  .  y  i + p 


Now  using  equation  (HI-6)  ir  the  proof  of  Theorem  TT.-2,  we  see  that  for  T  -  0, 
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For  the  case  T0  <  0,  we  use  equation  (IH-3)  of  Theorem  IH-2.  Then, 


1 

W) 


*  (- - -~32)  -  *  (~====J£)]  |d  *  (u)  d  *  (v) 

'  1  "P 32  '  1 "  P^2 


/ d  4>  (u)  d  *  (v)  =  4>  (T). 


##### 


In  order  to  test  the  accuracy  of  the  approximation,  the  true  Pn  and  approximate 
Pn  were  calculated  and  are  displayed  in  Table  IH-1,  for  n«=3  or  5,  and  for  various 
values  of  p 4  ,  ,  and  Tj.  The  primary  methods  of  calculating  Pn  were  Theorem  in-1 

and  formula’ (Hi-2),  in  cases  where  the  Gaussian  process  X=(Xj . Xn)  is  Markovian. 

An  additional  method  for  X  Markovian  is  mentioned  in  the  notes.  Some  special  cases 
where  X  is  not  Markovian  were  tested  by  use  of  formula  (B-4)  of  Appendix  B. 

In  most  cases  in  Table  in-1,  X  is  stationary,  while  in  some  cases  it  is  not,  as 
noted,  hi  most  cases  the  threshold  sequence  is  constant,  but  not  in  others. 

For  the  cases  where  X  is  Markovian,  the  errors  in  Pn  are  in  the  order  of  .01. 

The  errors  are  greater  for  Pn  close  to  .  5  than  for  Pn  close  to  1.  0,  as  might  be 
expected.  The  errors  for  n«=5  are  not  substantially  different  from  those  for  n  =  3. 

Note  particularly  example  (11),  which  is  both  non-stationary  and  has  non-constant 
thresholds  —  the  error  is  .  003,  which  is  very  small  considering  that  Pn= .  562. 

Note  that  the  assumed  correlations  are  in  the  range  .4  to  .  7.  In  general,  one 
expects  less  error  for  very  high  correlation  or  very  low  (absolute)  correlation, 
since  the  approximation  is  perfect  if  (a)  p  **  0  throughout  X  or  (b)  p  =  1  throughout  X 
and  the  single-trial  success  probabilities  are  unimodal  (i.e, ,  non-decreasing  prior 
to  some  point  and  non-increasing  thereafter). 

For  the  last  three  cases  of  Table  in-1,  X  is  not  Markovian  and  the  errors  are 
somewhat  higher,  .  068  for  n=  5  and  n=  10,  and  the  approximation  could  not  be  rated 
better  than  fair.  Nevertheless,  the  approximation  is  still  a  better  estimate  than 
would  be  obtained  by  assuming  independence  (being  lower  than  the  latter). 

Wc  concludo  that  the  approximation  is  very  good  for  at  least  five  trials  in  case  X 
is  Gaussian  Markov.  This  would  be  implied  if  X*  is  Gaussian  Markov,  but  not 
conversely.  Stationarity  and  constant  thresholds  do  not  appear  important,  For  X 
not  Markovian,  it  is  plausible  that  the  approximation  will  be  fair  in  many  cases  of 
interest  —  certainly  examples  are  at  hand  where  the  error  is  very  large,  especially 
as  a  percentage  of  1  -  Pn. 
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TABLE  I II  -  1 


EXAMPLES  OF  ERROR  IN  APPROXIMATING  GAUSSIAN  cdp 

No. 

of  trials  Correlations 

Thresholds 
(in  cr 's  from  mean)  * 

True  cdp 

Approximation  cdp 

Error 

n 

Pi,  i— 1 

Ti 

Pn 

pn 

■6  _  p 

*n  *n 

-  Markov  Gaussian  Process  - 

(1) 

5 

.6 

1.0 

.443 

.453 

.010 

(2) 

5 

.6 

.5 

.687 

.696 

.009 

(3) 

5 

.4 

1.0 

.501 

.505 

.004 

(4) 

3 

l/VS 

0 

.708 

.721 

.013 

(5) 

3 

1/V5 

0 

.784 

.790 

.006 

(6) 

3 

l/VS 

f2 

.153  ±  .013 

.164 

.011 

(7) 

3 

l/VS 

¥*~ 

.416  -  .020 

.425 

.009 

(8) 

3 

l/VF 

K2“ 

.483  ±  .014 

.486 

.003 

(9) 

3 

l/VT 

-l/VS 

.911  i  .006 

.912 

.001 

(10) 

3 

i/vr 

-2/vs 

.972  ±  .003 

.972 

.000 

(11) 

3 

.6,. 36 

(1.0,0, 1.0) 

.562 

.565 

.003 

(12) 

3 

.7 

(.4.0, .4) 

.611 

.614 

.003 

(13) 

3 

.7 

(-.2,0, +.4) 

.703 

.709 

.006 

-  Gaussian  Process  Not  Markov  - 

(14) 

(15) 

(16) 

2 

5 

10 

(Pii  =  1  1 

jp£  -hitr 

0 

0 

0 

.667 

.833 

.919 

.667 

.901 

.987 

.068 

.068 

Notes 

(1)  In  examples  (4)  through  (11) ,  Pn  was  computed  by  Theorem  113-1  —  the  "-"  in  (6) 
through  (10)  indicates  the  computed  upper  and  lower  Riemann  sums  in  performing 
the  numerical  integration.  In  examples  (1),  (2),  and  (3),  formula  (ID-2) was  used. 

In  (12)  ard  (13),  a  more  tedious  calculation  of  Pn  was  performed:  the  three 
Gaussian  distributions  were  each  grouped  into  fourteen  states  and  the  two  14  x  14 
transition  matrices  were  multiplied.  In  examples  (14) ,  (15) ,  and  (16) ,  formula 
(B-4)of  Appendix  Bwas  used  for  Pn. 

(2)  In  all  cases  ,  the  approximation  method  using  Figures  III— 1  through  m-4  was  used 
for  Ifo. 

(3)  In  example  (11),  (X1;X2,  X3)  is  stationary,  since  the  two  correlations  are  not  equal. 
In  (14) ,  (15) ,  and  (16) ,  X  is  again  not  stationary.  In  all  other  cases,  X  is  stationary. 

(4)  The  thresholds  are  not  constant  hi  examples  (11) ,  (12) ,  and  (13) ,  but  are  constant 
elsewhere. 
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CHA?TE_R__I_V 
STEP  PROCESSES 


In  this  chapter  the  underlying  continuous -parameter  stochastic  process  X*  is 
assumed  to  be  a  step  process,  defined  in  the  first  section.  Intuitively,  one  may 
think  of  the  sample  functions  of  the  step  process  as  being  step-functions,  i.e. , 
constant  over  a  period  of  time  until  a  jump  occurs.  After  the  jump  occurs,  a  new 
value  for  ihe  process  is  chosen  which  is  independent  of  the  values  before  the  jump. 
The  occurrence  of  jumps  is  a  Poisson  process.  Pare  step  processes  of  this  form 
are  probably  too  idealized  to  be  realized  in  physical  detection  processes  —  their 
principal  usefulness  is  as  a  first  approximation  to  the  step-plus-jitter  processes 
considered  in  Chapter  V. 

In  Theorems  IV-1  and  IV-2,  it  is  assumed  that  the  threshold  function  is 
"uni modal. "  Theorem  IV-1  then  gives  a  formula  for  cdp  when  the  continuous- 
parameter  process  is  sampled  discretely.  The  corollary  to  this  theorem  gives 
a  neater  form  of  the  cdp  formula,  in  the  case  where  the  time  between  observations 
is  constant.  Theorem  IV-2  passes  the  result  of  Theorem  IV-1  to  a  limiting  case, 
where  the  step  process  is  observed  continuously. 

The  final  section  deals  with  an  arbitrary  threshold  function,  hi  this  case 
convenient  exact  formulas  for  cdp  are  not  available.  However,  a  recursive 
procedure  has  been  devised  which  is  suitable  when  the  number  of  observations 
is  not  large.  The  number  of  multiplications  required  to  compute  cdp  for  a 
sequence  of  n  observations  using  the  recursive  relations  is  of  the  order  of  n2. 


Definitions 


The  definition  of  a  step  process  requires  the  specification  of  two  auxiliary 
processes  Y  and  N.  The  process  Y  consists  of  a  sequence  of  independent, 
identically-distributed  random  variables  Yj  for  i  =  0, 1, 2, . . . .  The  common 
distribution  function  of  the  random  variables  Yi  is  called  the  location-after-jump 
distribution,  and  will  be  denoted  by  K.  The  process  N,  called  the  aggregate -jump 
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process,  is  specified  to  be  a  Poisson*  process  with  intensity  X  (see  reference  [q]  for 
an  excellent  elementarv  discussion  of  this  Drocess):  N»  is  the  number  of  iumps  which 

**  *  '  v  - 

occur  from  time  zero  up  to  and  including  time  t .  The  numbers  of  jumps  occurring 
in  disjoint  intervals  are  independent.  Moreover,  the  probability  of  any  number  of 
jumps  occurring  in  a  given  interval  depends  only  upon  the  length  of  the  interval  and 
not  upon  its  location  in  time.  The  expected  number  of  jumps  in  time  t  is  X  t  and 


Pr(  Nt=m}  —  for  m= 0,1 . 

hi  particular,  the  probability  of  no  jump  in  any  interval  of  length  s  is  e  **■  s 
The  step  process,  X*,  is  now  defined  by  the  following  composition: 


X**  =  Yn  for  s  1  0. 
t 

k 

When  the  location-after-jump  distribution  is  normal  with  standard  deviation  a , 
X*  has  been  referred  to  as  a  "(X,cr)-procese"  in  Appendix  B  (originated  by  J.  D. 
Kettelle  Jr. )  of  reference  ,rh]. 

Clearly,  X*  simply  describes  a  special  type  of  sampling  scheme  where  a  new 
sample  is  drawn  from  the  distribution  K  whenever  a  jump  occurs  (as  indicated  by  the 
process  N).  Each  new  sample  is  independent  of  those  previously  drawn. 

A  threshold  function  is  said  to  be  uni  modal  if  it  is  non-increasing  prior  to 
some  parameter  value  (not  necessarily  unique)  at  which  the  threshold  is  minimal 
and  therefore  non-decreasing.  Actually,  the  term' VmimodaT  would  be  more  aptly 
applied  to  the  corresponding  single-trial  success  probabilities,  pt,  since  these 
rise  to  a  maximum  and  are  non -increasing  thereafter. 

It  is  shown  in  Theorem  C-4  of  Appendix  C  that  the  autocorrelation  between 
observations  separated  by  s  in  a  step  process  is  e"*  s.  We  note,  without  proof, 
that  a  step-process  is  Markovian  —  we  do  not  use  this  fact  per  se. 


*  It  should  be  noted  that  in  the  physical  process  of  reference  [a],  which  provides 
a  principal  motivation  for  considering  step  processes,  the  occurrence  of  jumps 
fits  much  better  to  an  Erlang  process  of  order  two  or  three  than  to  a  Poisson 
process  (Erlang  of  order  one). 
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Unimodal  Threshold  Theorems 


In  this  section,  we  assume  the  threshold  function  T*  is  unimodal.  Theorem  IV-1 
will  give  the  formula  for  cdp  -  Pn  for  the  case  where  the  process  X  *  is  observed  at 
n  arbitrary  discrete  points  in  time,  and  Theorem  IV-2  will  extend  this  result  to  the 
continuous-parameter  case.  We  repeat  the  convention  made  in  Chapter  I  that  the 
symbols  X,  T,  andp  denote  respectively  the  process,  threshold  function,  and  single  - 
trial  success  function  obtained  by  sampling  the  continuous-parameter  process  X*  at 
discrete  points  in  time  tj_,  •  •  • ,  V  Note  that  if  T*  is  unimodal,  then  T  will  also  be 
unimodal. 

Theorem  IV-1.  Let  X  be  the  discrete  parameter  process  obtained  by  observing 
X  *  at  times  t^ , . . . ,  1^,  and  .  (for  i  =  2,3,...,n)be  the  probability  of  at  least  one 
jump  in  an  interval  of  length  tj  -tj_j_.  Thus 


/3j  =  1  -  e~x 


Let  c  be  an  observation  corresponding  to  a  minimum  threshold  Tc.  Then  PQ  is 
given  by  * 


pn=i-<i-pc)  *n 


‘^i+1  pi>  i=o+i (1  pi)" 


(IV-1) 


Proof.  We  make  use  of  the  following  elementary  fact  about  conditional  prob¬ 
abilities:  Let  A,  B,  and  C  be  arbitrary  events  and  let  C  be  the  complementary 
event,  "not  C. "  Suppose,  in  addition,  that  B  is  independent  of  both  C  and  C .  Then 


Pt{a|b}  =r.{A|BOc}  Pr{  C}  +  Pr{  a|bPiC}  Pr{  C}  . 


When  the  upper  limit  of  the  symbol  n  is  less  than  the  lower  limit,  we  follow 
the  convention  that  the  product  is  then  equal  to  one. 
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Let  Fj  correspond  to  the  event  Xj  —  Tj,  and  correspond  to  the  event  "at  least 
one  jump  occurs  between  tj_^  and  tj . "  The  probability  Pn  may  then  be  written  as 


n 

n 

i=l 


di, 


(IV-2) 


where 

dj  =  Pr{  Fi  |  Fx  nFg. . .  Pi  F^}  for  i  >  1 
dj  =  Pr {  Fx}  =pr 


Noting  that  Lj  is  independent  of  Fj  Pi. . .  P  Fj.^,  we  may  use  the  above  remark 
and  write 


di  =  Pr{  FilFjOFgn  ...  H  Fj^PlLj}  Pr{  Lj} 


+  Pr{  Fi|F1nF2n  ...  PlF.^PlLj}  Pr {  1^ }  . 


(IV-3) 


Now,  if  i  1  c,  then 


,J.=P  fl  +_2_^-  (i-^p  ).  (IV -4) 

Pi-1  Pi-1 


The  first  term  arises  from  the  fact  that  when  a  jump  occurs  in  the  interval  between 
ti  and  t|_j_,  the  event  Fi  is  independent  of  the  past.  Thus  the  first  summand  in 
equation  tIV-3)  is  just  Pj  j3. .  When  no  jump  occurs  in  the  interval  between  ti  and 
tj_i,  we  must  take  the  past  behavior  of  the  process  into  account.  The  conditioning 
in  (IV-3)  states  that,  among  ether  things,  the  event  Fj_^  has  occurred.  This  means 
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that  -  T^,  and  consequently  Xj  1  since  there  has  not  been  a  jump  between 
t^_i  and  t* .  Now,  since  the  thresholds  do  not  get  any  smaller  as  we  proceed  backwards 
in  time,  we  gain  no  new  information  from  the  condition  that  events  F^, . . . ,  have 
occurred.  Thus 


PrfFjlFjO...  ^Prfjq  iTjlXj  <TW}  -  -£*- 

pi-l 


whence  formula  (1V-4)  follows. 

The  situation  is  slightly  simpler  whenever  i  >  c.  hi  this  case, 


di  =  ^  /3i  +  Pi  =  1  -  p..  (IV-5) 


As  before,  the  first  summand  of  (IV-3)  becomes  p.  /S.,  since  the  event  F.  is 
independent  of  the  past  when  a  jump  occurs  between  tj_j  and  tj.  When  no  jump 
occurs  between  tj_i  and  tj,  we  have  Pr  {  F.  |  Fj^  Pi. .  .PF^j}  « 1,  since,  in  this 
case,  Xj.j^Xj  and  the  conditioning  states  that  Xj.^  £  T^.  But  i  >  c  implies 
that  £  Tj,  and  .therefore,  Xj  £  Tj.  Thus  when  i  >  c,  the  second  summand 
in  (IV-3)  is  given  by  /fj.and  this  establishes  (IV-5).  Combining  (IV~4)  and  (IV-5) 
by  means  of  (IV-2),we  obtain  the  conclusion. 

##### 

nwirWir 

Corollary.  Suppose  the  observations  are  uniformly  spaced,  that  is, 


t|  =  (i-l)6  for  i  =  l,  2, . . .  ,n. 


Then  the  formula  for  Pn  is 


1-P, 


Pn 


n 

n 

i=l 


<1-0  Pi), 


where  j3  is  the  probability  of  at  least  one  jump  in  an  interval  of  length  6  ,  i.e. , 
/3=l-e"*6. 
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In  the  next  theorem  we  proceed  to  compute  Poo  ,  the  limiting  value  of  cdp  when  it 
is  assumed  that  the  process  X*  can  be  continuously  observed  over  an  entire  interval 
[0,t].  Such  a  probability  might  be  expressed  formally  as 


Poo  =  1  -  Pr  {  sup  X*  -  T*  <_0}; 
Oisit 


we  define  its  value  to  be  lim^^  Pn,  where  Pn  is  the  cdp  resulting  from  taking  n 
uniformly-spaced  observations  in  the  interval  [0,t],  with  the  first,  observation  at  0 
and  the  last  at  t. 

(It  can  be  shown  that  even  when  the  observations  are  not  uniformly  spaced,  the 
same  limit  will  be  obtained  as  long  as  the  first  and  last  observations  are  at  times  0 
and  t  respectively,  and  the  maximum  time  between  observations  approaches  zero. ) 

Recall  that  p*  was  defined  to  be  the  probability  of  a  success  in  a  trial  at  time  t , 

and  define  sG  to  be  a  point  such  that  T  *  is  a  minimum  threshold. 

*0 

Theorem  IV- 2 .  *  Let  the  unimodal  threshold  function  T*  be  a  continuous 
function.  Then  the  limiting  cdp,  P^  ,  for  continuous  observations  over  the  interval 
[0,t]  is  given  by 


Poo  =  1  -  (1  -P*q)  <3xp  [-X  /Jp*  ds], 


where  X  is  the  intensity  of  the  Poisson  aggregate -jump  process. 

Proof.  Let  the  interval  (0,  t]  be  divided  uniformly  into  n  - 1  intervals  of 
length  6  — the  observations  taking  place  at  the  points  tj  =  (i  - 1)6  .  Now,  using 


In  the  more  special  case  when  the  thresholds  are  monotonic,  this  formula 
was  obtained  earlier  by  J.  D.  Kettelle  Jr.  (see  reference  [h],  page  B-4) 
using  a  differential  equation  approach.  Both  results  include  Theorem  n-1 
of  Chapter  U,  which  assumes  that  the  thresholds  are  constant. 
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the  corollary  to  Theorem  IV-1,  we  have 


1-PC 
1-0  Pc 


.n  (i-0Pj), 

1=1  1 


where 


0  =  l~e'X<5  =  A6  +o(6). 


If  there  is  more  than  one  candidate  for  c,  we  choose  c  so  that  is  at  minimum  distance 
from  s0.  Clearly  then,  tc  -*  s0  as  n  -*• » .  We  compute 


P*,  =  lim  Pn 

n  ->oo  “ 


by  the  use  of  logarithms.  Now 


In  Pn  =  In  (1  -pc)  -  In  (1  -ft  pc)  +  S  In  (1  -ft  p.) 


=  In  (1  -pc)  -  In  (1  -ft  pc)  +  S  In  (1-Xpj  6  +  o(6)) 

i=l 

n 

=  In  (1  -pc)  -  In  (1  -ft  p  )  +  S  (-  A.  Pi  6  )  +  n  *  o  (6). 

i=l 


Finally,  since  lim  ft  =0  and  n=l+t/6  ,  we  have 
n-*-«> 


In  Pa, 


lim  In  Pn  =  In  (1-p*  )  - 
n-»«  s0 


s 


ds. 
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Here,  the  fact  that  p*  is  non-decreasing  and  then  non -increasing  ensures  that  it  is 
continuous  almost  everywhere  and  hence  Riemann-integrable.  Further 
limjj^.,0  pc  =  psQ  since  pc  =  l  -KIT^),  Ttc  TSq  from  the  right  (since  T  is  con¬ 
tinuous  and  Ts0  is  a  minimum  threshold),  and  K  is  a  distribution  function  and  hence 
right  continuous.  \*y 

'  '  ..  ##### 

< 

General  Thresholds  —  A  Recursive  Sfcheme 

I  /. ' 

One  might  attempt  to  compute  cdp  for  n  discrete  observations  of  a  step  process 
by  simply  making  a  list  eft'  all  the'different  configurations  of  jumps  which  are  possible 
in  the  n-1  intervals  of  time  between  n  observations,  and  then  compute  the  non¬ 
detection  probability  for  each  configuration.  The  result  of  adding  these  together, 
weighted  by  the  probability  of ''dach  configuration  of  jumps  would  then  give  1  -  Pn. 
However,  if  we  denote  the  evdmt  "at  least  one  jump"  by  a  1  and  the  event  "no  jumps" 
by  a  0,  then  it  is  clear  that  thejte  are  2(n-l)  ways  the  jumps  may  occur.  (We  are' 
not  particularly  interested  in  "how  many"  jumps  occur  in  an  interval,  since  the  net 
effect  of  any  number  of  jumps  is  to  cause  us  to  take  another  independent  sample 
from  the  distribution  K. )  Clearly,  the  above  method  of  computing  cdp  would  become 
tedious  for  large  n.  The  recursive  scheme  to  be  described  is  a  considerable 
improvement  over  such  a  straightforward  approach. 

As  before,  let  {  tj }  be  a  sequence  of  observations,  and  /?i  be  the  probability  of 
at  least  one  jump  occurring  in  an  interval  of  length  tj  -tj-i.  In  addition,  let 


-  =  Pr  { Xi  i.  min  Tj}=K(  min  Tj)  fork>j. 
*  j -i -k  jiiik 


Note  that  q.  .  =  p.  . 
l.J  ) 

We  shall  compute  Pa  forn=  1, 2, 3, 4  in  order  to  demonstrate  the  method  of 
computing  Pn+1  in  terms  of  Pn.  Table  IV-1  shows  this  computation.  The  symbol 
(^(k)  denotes  the  contribution  to  Pm  from  all  configurations  of  jumps  ending  in 
k  zeros.  When  k=0,  we,  of  course ;  refer  to  those  configurations  ending  with  a  1. 
The  case  n=  1  is  trivial,  i.  e. ,  Pj  =  q.  .  =  Pr  {  X,  <  T^  }  .  An  inspection  of 
Table  IV-1  shows  that,  ’ 


TABLE  IV-1 


CONTRIBUTIONS  TO  cdp —  RECURSIVE  SCHEME 


Configuration  of  Jumps 


Contribution  to  P. 


n 


n  =  3 


n=2  < 


r 


n=4  A 


1 

0 

1  1 
0  1 
1  0 
0  0 

111 
Oil 
10  1 
0  0  1 
110 
0  10 
10  0 
0  0  0 


^2  q2,2  qi,l 
^2  q2,l 


^3  ^2  *3,3  q2,2  qi,l 

;°3  ^2  %t3  q2,l 

^3  ^2  q3,2  qi»l 

^3  '^2 

^4  ^3  ^2  q4,4  3  q2,2  qi,l 

^4  ^3  ^2  q4,4  **3,3  q2,l 

^4  ^3  ^2  q4,4  q3,2  qi,l 

^4  q4,4  ^  1 

^4  ^3  ^2  q4,3  q2,2  qi,l 

^4  ^3  ^2  q4,3  q2, 1 

^4  ^3  ^2  q4,2'qi.l 

^4  ^3  ^2  q4,l 


Q, 


Q, 


(0) 

5 

(1) 


Q. 


Q. 


Q. 


(0) 


(1) 

\ 

(2) 


y  q 


(0) 


Q. 


(i) 


Q 


Q, 


(2) 

4 

(3) 
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Moreover, 


Qg(0)  =  H3  Qg  g  Pj, 


Sw-*,?iSw 
3  3  q2,2  2 


3  „  3  q21  - 


l 


Q  =  0  q  P 
^4  P4  q4,4  3 


qM-J  Mq(°) 

4  4  *3,3  3 


q<2)=S  XiQ(X) 

^  '4  %,2  ^ 


Q«»)-J  -ill  Q  <2>. 

4  4  S,1  3 


The  general  recursive  formulas  are  given  by  the  following  set  of  equations: 


5n  =  V0,  +  S>(1)  +  "-+Sl(n'1) 


%(<>)  -  <»,  \n  *»-1 


Vi», 

Ti-l,n-l 
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f 


q».j  -i*±,  to 

^  n  Vl,n-2  "-1 


(^(h-1)  =  j3n  J-  —  * 1  Q_  ^n~2^ 


Si-l.l 


n-1 


The  procedure  begins  at  n=  2,  where 


and 


Assuming  that  the  ratios  involving  j  have  been  computed  beforehand,  it  takes 
about  2n  multiplications  to  go  from  Pn_^  ’to  Pn.  Thus,  in  order  to  compute  Pn 
starting  from  P2  we  must  make 


n 

2  S 
i=3 


i  =  n(n  +  l) 


6 


multiplications.  Clearly  this  is  better  than  the  "straightforward  approach"  which 
would  involve  more  than  2n_1  multiplications.  Certain  special  threshold  functions 
will  also  reduce  the  amount  of  calculation. 


! 


V 


'  CHAPTER 

i  - 

STEP-PLUS- JITTER  PROCESSES 


In  this  chapter  we  assume  that  the  continuous -parameter  process  X*  is 
a  "step-plus -jitter"  process.  This  is  a  step  process  perturbed  by  slight  distur¬ 
bances  which  we  call  "jitter."  Precise  definitions  will  be  given  in  the  next 
section.  The  computation  of  cdp,  Ih,  will  be  discussed  only  for  the  case  of  a 
finite  sequence  of  observations  of  the  continuous-parameter  process,  i.e. ,  no 
limiting  cases  will  be  considered. 

Recall  that  the  problem  of  finding  non-recursive  formulas  for  cdp  for 
an  ordinary  step  process  was  quite  difficult  except  when  the  threshold  function  T 
was  unimodal.  The  presence  of  jitter  farther  complicates  matters  ^md  in  fact 
no  non-recursive  formulas  have  been  found,  even  in  the  case  where  the  threshold 
function  is  constant.  However,  recursive  relations  similar  to  those  of  Chapter  IV 
are  derived  which  are  valid  for  an  arbitrary  threshold  function  and  for  any  finite 
sequence  of  observations .  These  are  given  in  the  second  section.  The  main  dis¬ 
advantage  of  these  relations  is  that  they  depend  upon  a  number  of  integral  expressions 
which  may  be  difficult  to  evaluate.  Even  assuming  the  values  of  the  integrals  are 
known,  the  number  of  multiplications  to  compute  cdp,  Pn,  is  of  the  order  of  n2. 

In  order  to  avoid  these  difficulties,  an  approximation  to  the  step-plus -jitter 
process  by  a  special  "m-dependent"  (see  Appendix  A)  process  is  discussed  in  the 
last  two  sections.  When  the  threshold  function  is  constant  and  the  observations 
are  uniformly  spaced,  cdp  may  be  computed  for  the  approximate  step-plus -jitter 
process  by  recursive  relations  which  greatly  reduce  the  number  of  integrals  to  be 
evaluated.  In  addition,  the  computation  of  cdp  for  the  approximation  requires  merely 
order  of  n  multiplications.  The  last  section  deals  with  the  general  m-dependent 
approximation,  while  the  section  preceding  it  considers  in  detail  the  special  2-depen- 
dent  case.  Here  numerical  calculations  as  shown  in  Figures  V-l  through  V-3  indicate 
that  the  approximation  is  most  satisfactory  when  there  is  a  high  probability  of  a  jump 
occuring  between  observations. 
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Definitions 


A  step-plus -  jitter  process  X*  is  defined  to  be  the  sum  of  two  stochastic 
processes  Z*  and  J*,  where  Z*  is  a  step  process,  and  J*  (called  jitter)  is  a  process 
of  independent,  identically-distributed  random  variables , which  is  assumed  to  be 
statistically  independent  of  Z*;  the  common  distribution  function  of  the  random  var¬ 
iables  J£  %  'ill  be  denoted  by  G. 

We  recall  a  step  process,  Z*,  is  defined  by  the  equation 


where  Y  is  a  process  of  independent  identically-distributed  random  variables ,  and  N 
is  a  Poisson  process  describing  the  occurrence  of  jumps. 

As  usual,  let  X,  Z,  and  J  be  the  discrete-parameter  process  resulting  from 
making  observations  at  the  points  t  j, . . . , t^.  For  any  such  sequence  of  observations, 
we  let 


Ek,  j  =  Pr  {Xj  <  Tj ,  Xi+i  <  Tj+i , . 


•Xk±Tk 


no  jumps  between  j  and  k}  . 


The  quantity  fk>  j  may  be  computed  by 


fk,j"  Pr<  Zj+  *}  <Tj  •zj+Jj+1£Tj+3 . Zj  +  j.<Tk} 

- •  Pr{  Jj  ^Tj  — Zj ,  Jj+j£Tj+ j  -Zj ,  •  •  • )  J|^  j}  (V- ^ 

roe  k 

=  J*  n  G(Trx)  dK(x), 

00 

where  G  is  defined  above  <wd  K  is  the  location-after- jump  distribution  of  the  step 
process.  Note  that  when  the  threshold  function  T  is  constant  (T=T0) ,  fk  i  depends 
only  upon  k-j.  In  this  case,  we  denote  fk>  j  by  fk_-  and 


-54- 


9 


(V-2) 


fk-j  < 


O^'^To-x)  dK(x), 


The  autocorrelation  associated  with  the  step-plus-jitter  process  Z*  +  J*  is 


a  (s)  = 


e"  for  s^O, 


of<0)  =1, 


where  c and  cr^  are  respectively  the  variance  of  K  and  G,  and  X  is  the  intensity 
of  the  Poisson  process  N-  This  is  seen  by  applying  Theorems  C-2  and  C-4  of 
Appendix  C.  Note  that  a  is  discontinuous  at  0  (assuming,  as  we  do,  that  /  0, 
i.  e. ,  the  jitter  is  not  constant) . 

Exact  Recursive  Formula  for  cdp 

In  this  section,  recursive  relations  will  be  displayed  which  allow  one  to 
compute  the  exact  value  of  cdp,  Pn,  whenever  the  underlying  continuous-parameter 
process  is  step-plus -jitter.  These  relations  are  identical  in  form  (with  a  substitu¬ 
tion  noted  below)  to  the  relations  appearing  in  the  last  section  of  Chapter  IV. 

They  apply  with  arbitrary  threshold  function. 

Again,  we  use  1  and  0  to  represent  the  occurrence  or  non-occurrence  of 
one  or  more  jumps  in  a  given  interval  and  j3j  for  j>2  is  the  probability  of  at  least 
one  »mp  occurringin  an  interval  of  length  tj-tj_^.  The  symbol  is  used  to  denote 
the  i  ontribution  to  Pn  from  all  configurations  of  jumps  ending  in  k  zeros.  The  only 
specific  change  which  has  been  made  in  going  from  the  relations  of  Chapter  IV  to 
those  of  this  section  is  to  replace  j  with  f^  defined  in  the  preceding  section. 

The  relations  are  now  given  by  the  following  set  of  equations: 


Pn  =Q(n0) 


+  . 


..  4Q 


<n-l) 

n 
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-(0)  .  „  - 
y  n  =  Pn  hi,n  *h-l 


fn,n-l 

^n-l.n-l 


*n,n-2 

*n-l,n-2 


Q 


(n-1) 

n 


=  0 n 


n, 


fn-l, 


1 

1 


Q 


(n-2) 
n-1  • 


The  procedure  begins  at  n=2,  where 


Q^-p2y  1,1 

and 

=  H  *2,  1  * 


The  reader  may  verify  these  equations  by  consulting  Table  IV- 1  of  Chapter 
IV,  keeping  in  mind  that  the  symbols  j  should  be  replaced  by  y  Note  that 
multiplications  in  order  of  n2  are  required  to  compute  Pn,  assuming  that  the  required 
ratios  of  the  j  are  calculated  in  advance.  In  view  of  equation  (V-l),  the  calcula¬ 
tion  of  j  coula  be  a  formidable  task.  The  type  of  approximation  introduced  in  the 
next  two  sections  substantially  reduces  the  number  of  f^  j  to  be  computed. 

The  2-Dependent  Approximation 

In  this  section  we  discuss  in  detail  an  approximation  to  the  step-plus -jitter 
process  by  a  2-dependent  process  when  the  threshold  function  is  constant,  and  the 
observations  are  uniformly  spaced  (i.e. ,  tj  =  (i-1)  6).  This  is  a  special  case  of  the 
general  m-dependent  approximation  discussed  in  the  next  section.  We  have  singled 
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•sis* 


out  the  2-dependent  approximation  because  it  is  the  simplest  non-trivial  example  of 
the  general  method.  Appendix  A  defines  m-dependent  processes,  which  are  used  in 
these  approximations. 

As  we  have  seen  throughout  this  report,  the  presence  of  correlation  between 
random  variables  makes  the  problem  of  computing  cdp  vastly  more  difficult  than  was 
the  case  for  independent  random  variables.  In  fact,  the  literature  survey  in  Appendix  B 
showed  for  the  class  of  Gaussian  processes,  there  are  no  finite  procedures  or  tabula¬ 
tions  available  for  the  computation  (under  general  conditions)  of  cdp  for  as  few  as 
three  trials.  For  the  two-dependent  approximation  X ,  however,  the  random  variables 
X£  and  X  j  are  independent  whenever  |  i-j  |  >2.  This  manifests  itself  in  the  fact 
that  the  recursive  formulas  obtained  in  this  section  for  the  approximation  will  require 
only  order  n  multiplications  for  the  computation  of  cdp — in  contrast  to  order  n^  multi¬ 
plications  to  compute  the  cdp  for  the  actual  step-plus- jitter  process. 

As  was  noted  earlier,  whenever  the  threshold  function  is  constant,  fiC}  j  depends 
only  upon  k-j  and  is  denoted  by  f^.j . 

The  approximate  step-plus-jitter  process  is  obtained  by  constructing  a  new 
aggregate  jump  process  F,  which  will  resemble  the  discretely  observed  Poisson  pro¬ 
cess  with  the  exception  that  at  least  one  or  more  jumps  must  occur  in  every  three 
or  more  successive  intervals . 

Let 


11  =  2  t\.  for  i>  1 
1  1=2  1 


(V-3) 


=  0, 


where  rjj  may  assume  only  the  values  zero  or  one.  We  will  consider  rjj  =  1  to  mean 
that  one  jump  has  occurred  in  the  interval  the  (l-l)s*  and  1^  observation  while  t)  j=0 
will  mean  that  no  jump  has  occurred  in  this  interval.  The  process  r 7  is  defined  to  be 
a  stationary  2-stage  Markov  process  (not  to  be  confused  with  a  2-dependent  process — 
(see  Appendix  A)  with  two  states,  0  and  1.  The  transition  function  ¥  , 


*(i,  j;k)  =  Pr{  t)1+2  =  k  1^=1  and  rj1+1  =j }  for  any  1>2, 
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is  specified  to  be  of  the  form 


¥(i,j;l)  =x. 


whenever  i  and  j  are  not  both  zero,  and 


*(0,0;1)  =1. 


We  have  chosen  this  particular  specification  in  order  to  have  the  process,  V  >  resemble 
a  sequence  of  independent,  identically  distributed  random  variables.  The  constant  x 
(a  conditional  probability)  is,  at  this  point,  unspecified.  In  fact,  the  proper  selection 
of  x  is  the  critical  part  of  the  approximation. 

The  initial  distribution  41 * 


0(i,j)  =  Pr  {r?2  =i,r?3  =j}  , 


is  taken  to  be  the  stationary  initial  distri  bution  found  by  solving  equations 


0(0, j)  *  (0, j;k)  +  0(1, j)  ¥  (1,  j;k)  =  0(j,k)  for  0<j,  k<l. 


The  solution  is,  of  course,  expressed  in  terms  of  x  and  is  given  by 


0(0,0)  = 


X2  -3X  +3 


0(1,0)  =  — 


\  -3x  +3 
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0(0,1) 


X 


X2  -3x  +3 


0(1,1) 


X 

X2  -3x  +3 


Note  that 


Pr{i),  =1}  =#(1,0)  +#(1,1)  =-5-1— 
1  X^"3x  +3 


In  order  to  choose  x  »  we  equate  Pr  =  l}  with  the  probability  of  at  least  one 
jump  in  an  interval  of  length  6  for  a  Poisson  process ,  obtaining  the  relation 


1 

X2-3X  +3  ’ 


(V-4) 


or  equivalently 


(X2-3X  +3)  = 


Here  A  is  the  intensity  of  the  Poisson  process  N.  Note  that  (V-4)  implies  that , 
1-e-^ ,  the  probability  of  at  least  one  jump  in  an  interval  of  length  6  ,  must  be  at 
least  l/3  for  a  solution  to  exist.  Since  x  2  -  3x  +3  is  strictly  decreasing  for  x 
between  0  and  1,  a  solution  in  this  domain  will  be  unique  when  it  exists. 

The  7}  process  has  now  been  completely  specified,  and  hence  so  has  the 
aggregate  jump  process  r  which  was  defined  in  terms  of  rj  by  equation  (V-3) . 

Finally,  the  approximate  step-plus -jitter  process,  &,  is  defined  to  be 


X  =  Z  + J  , 


where 


2 


The  process  X  is  2-dependent  because  if  i-j  >2,  then  X*  and  X  j  are  independent, 
since  I'  will  have  increased  at  least  once  between  time  i  and  time  j.  Also,  the  stationarity 
of  X  is  a  direct  consequence  of  the  stationarity  of  ij 

Recursive  relations  will  be  derived  for  computing  cdp  for  X ,  under  the 
assumption  that  the  threshold  function  T  is  constant  (T=  T0) .  To  this  end,  Table  V-l 
gives  the  array  of  possible  realizations  of  t]  for  the  case  where  n=5  (i.e. ,  1=1, 2, 3, 4). 

Note  that 

Pr  {  TJj ,  • . . ,  Xjjl TJj  i  no  jumps  indicated  by  r  between  j  and  k} 


-  Pr{  Zj  +  Jj  <  Tq  , . . . ,  Zj  +  Jk^To) 


°k'i+1  Ob  -*)  dK(x)  =  fk.j  , 


by  equation  (V-2) . 

Each  row  in  Table  V-l  represents  a  different  realization  and  the  expression 
following  each  is  the  contribution  to  the  nondetection  probability  of  that  particular 
path. 

The  recursive  relationships  for  cdp,  Pfl,  are  given  by  writing  Pn  in  the  form 
Pn  =  *(1,1)  mJ*1)  +  *<1,0)m{,10)  +  ^(O.DM^1)  +  *(0,0)  a400), 


where  *  (i,  j)  is  the  contribution  to  ^  from  all  the  cases  where  the  first. two 

values  of  the  realizations  of  tj  are  i,  j.  We  may  express  in  terms  of  M^-i  by 

the  relations 


TABLE  V-l 


CONTRIBUTIONS  TO  cdp  —  RECURSIVE  SCHEME 


Jump  Configuration  _ Contribution  to  Pn 


1 

1 

1 

1 

H  1,1)  4(1, 1;1)  4(1, 1;1) 

%%%%% 

1 

1 

1 

0 

0(1,1)  4(1, l;l)  4(1, 1;0) 

foA^i 

1 

1 

0 

1 

0(1,1)  4(1, 1;0)  4(1, 0;1) 

Wi*o 

1 

1 

0 

0 

0(1,1)  4(1, 1;0)  4(1, 0;0) 

1 

0 

1 

1 

0(1,0)  4(1, 0;1)  4(0, 1;1) 

/ 

*0*1%% 

1 

0 

1 

0 

0(1,0)  4(l/0;l)  4(0, 1;0) 

/ 

%Vl 

1 

0 

0 

1 

0(1,0)  4(^ 

j,0;0)  4(0, 0;l) 

fbfefo 

0 

1 

1 

1 

0(0,1)  4(0 

ll;l)  4(1, 1;1) 

fl%%% 

0 

1 

1 

0 

0(0,1)  4(0, 1;1)  4(1, 1;0) 

Wi 

0 

1 

0 

1 

0< 0,1)  4(0, 1;0)  4(1, 0;1) 

hh*o 

0 

1 

0 

0 

0(0,1)  4(0, 1;0)  4(1, 0;0) 

hh  ' 

0 

0 

1 

1 

0(0,0)  4(0, 0;1)  4(0, 1;1) 

f2%% 

0 

0 

1 

0 

0(0,0)  4(0, 0;1)  4(0, 1;0) 

*2fl 

"61“ 


---  f0{*(l,j;0)  M^_0}  +  *(l,j;l)  M^} 

Mn01)  =  T~  <  *(0,  m  +  *(0, 1;1)  M^1})  } 

<0)4  *(0,0;l)  M<°_?  4  I®  . 

X1  *1 


and  the  initial  values  are 


(11)  ,  3 

M3  '  =fg 


(10) 

M3  =  fofl 


*,(01)  _  t  r 

Mg  -  fif0 


Mr  -  <2 


One  may  easily  see  that  these  relations  are  valid  by  inspecting  Table  V-l 
for  the  case  of  n=5. 

Note  that,  in  general,  one  never  needs  to  use  the  values  of  fj  for  j>2.  This 
is  what  makes  the  approximation  convenient  since  the  exact  expression  for  would 
involve  all  values  fg, . . .  ,fn-i*  Once  the  ratios  f2/ty  and  fj/fo  have  been  computed 
and  m(^)  are  known,  it  requires  only  10  multiplications  to  obtain  all  m(*S^  Thus  it 
only  requires  10  (n-3)  +4  multiplications  to  obtain  from  the  given  values  of  . 
Also  one  need  not  compute  %  separately  at  each  stage. 

Figure  V-l  shows  the  non-detection  probability  ^  for  a  step  process  Z 
(no  jitter  present)  and  the  corresponding  approximate  step  process  Z  versus  the 
number  of  trials  n.  The  single-trial  probability  of  failure  is  taken  to  be  .  8.  The 
comparison  is  made  for  a  high  probability  (.  865)  of  one  or  more  jumps  occurring 
between  trials  and  a  low  jump  probability  (394) .  Note  that  .  865  and  .  394  correspond 
to  A6=2and  A6=g,  where  A 6  is  the  expected  number  of  jumps  between  trials 
for  the  Poisson  process .  Also  note  that  .  394  is  close  to  the  limiting  value 
of  1/3  —  the  smallest  value  for  which  the  approximation  is  valid.  ( A  line 
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Probability  of  No  Detections  (Pn) 


FIGURE  V-l 


COMPARISON  OF  cdp  FOR  STEP  AND  APPROXIMATE  STEP  PROCESSES 


?  =  Probability  of  at  least  one  jump  between  trials 
-  Step  Process 

x  x  x  x  x  2-Dependent  Approximate  Step  Process 
- Independence  Between  Trials  (8=1) 


1.0 


.  01 1 - 1 - L - 1 _ I _ I _ I _ l _ I _ I _ I _ I  >  _ i _ L 

2  4  6  8  10  12  14 

Number  of  Trials  (n) 


-63- 


Probability  of  No  Detections  (Pq) 


Probability  of  No  Detections  (P^ 


representing  the  value  of  1-Pn  under  the  assumption  of  independence  between 
trials  has  been  included  in  the  figure  for  reference.)  The  formula  for  unimodal 
thresholds  (Theorem  IV- 1,  Chapter  IV)  was  used  to  compute  Pn  for  the  step  process. 
The  figure  shows  clearly  that  even  in  the  worse  of  the  two  cases  (jump 
probability  =  .  394),  the  percentage  error  does  not  exceed  about  6%. 


In  order  to  test  the  approximation  when  jitter  is  actually  present,  we  have 
made  a  comparison  for  the  following  special  type  of  step-plus-jitter  process.  (The 
results  appear  in  Figures  V-3  and  V-4).  Let  the  "location-after- jump*'  distribution 
K  be  given  by 

fo  when  x  <■  -a  *"*) 


K(xH 


x+a 

2a 


when  ~a<  x<  a  , 


Q  when  x>a 

and  the  jitter  distribution  G  be  given  by 


r0  when  x  <  -c 


x+c 


G(x)=  when  -o<_x<  c'^ 

2c 


1  when  x  >  c 


Both  K  and  G  have  thus  been  taken  to  be  uniform  distributions  where  the  mass  of  K  is 
located  between  -a  and  a  and  the  mass  of  G  is  located  between  -c  and  c.  We  shall 
choose  c  to  be  smaller  than  a,  as  the  word  "jitter"  implies.  Now 


-  /Gm+1  (T0  -x)  dK(x) 

=  ~  /fa  G  m+1(TJj-x)  dx  lor  m>  0, 


and,  assuming  that  T0  =  0, 


c 


fm= 


1 

2a 


/- 


a 


a 


„m+l  .  .  ,  a-c  , 

G  (-x)dx  =  -r—  +  - — — — 
2a  (m+2)a 


Note  that  as  the  jitter  becomes  smaller  and  smaller,  i.e. ,  o-*0,  ^  -*• \  which  corresponds 
to  the  value  of  <m  for  the  pure  step  process .  Figures  V-2  and  V-3  show  a  comparison 
between  Pn  as  computed  for  the  step-plus -jitter  process  and  for  the  approximate  step- 
plus-jitter  process  in  the  case  just  described.  In  each  figure  we  have  included  for 
comparison,  lines  representing  Pn  for  the  case  of  independence  between  trials  and  the 
case  of  the  pure  step  process  (i.  e. ,  without  the  jitter  present) .  Figure  V-2  assumes 
that  the  probability  of  at  least  one  jump  between  trials  is  .  865  and  Figure  V-3  assumes 
that  the  jump  probability  is  .394.  (These  are  the  two  cases  that  were  shown  in  Figure 
V-l  for  the  case  of  a  pure  step  process.)  The  figures  indicate  clearly  that  the  approxi¬ 
mation  is  much  better  when  the  probability  of  one  or  more  jumps  in  an  interval  is  high. 

This  is  to  be  expected  since  in  this  case  one  would  expect  F  to  be  a  better  approxima¬ 
tion  to  the  Poisson  process.  Also,  in  the  cases  considered,  the  values  of  Pn  as  computed 
for  the  pure  step  process  are  surprisingly  close  to  those  computed  for  the  actual  step- 
plus-jitter  process.  One  must  be  careful  in  drawing  general  conclusions,  however, 
since  the  G  and  K  distributions  are  of  a  very  special  type.  Finally,  note  what  a  poor 
approximation  is  given  by  the  assumption  of  independence  between  trials . 


The  m-dependent  Approximation 

In  this  section,  the  results  of  the  preceding  section  are  generalized  to  the 
case  of  an  m-dependent  approximation.  The  method  of  approach  will  be  exactly  the 
same,  i.e. ,  the  Poisson  arrival  process  is  approximated  by  a  multi-stage  Markov 
process  I\  The  approximate  step-plus-jitter  process  is  then  defined  in  terms  of  T. 

On  intuitive  grounds,  one  would  expect  the  approximation  to  become  better  with  increas¬ 
ing  m. 


Once  again  assume  that 


i 

ri  =i527?1’  for  i>x» 


(V-5) 


where  rj  may  assume  only  the  values  zero  and  one.  We  now  define  tj  to  be  a  stationary 
m-stage  Markov  process.  That  is,  the  transition  function  ♦  depends  on  the  past 


E 


I 
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m  positions  of  the  process.  Let 


i2 . yl)  =Pr{  V\  =  jUi_i  =im . =ii> 

and 

^<*1 . W  =Pr{i?2=ii.  r?c=i2»  *  •  •  ,7?m+l=im^  • 


where  the  i’s  and  j  are  either  zero  or  one.  The  transition  behavior  of  tj  will  once  again 
be  chosen  in  such  a  way  as  to  make  17  resemble  a  sequence  of  independent  identically  - 
distributed  random  variables,  the  exception  being  that  no  sequences  with  more  than  m 
successive  zeros  will  be  permitted.  Thus ,  the  transition  function  ^  is  defined  by 


*(il»  •  *  •  .i^l)  =  X  for  ix  +  .  .  .  +ik^0, 
*(0,...,0;1)  =  1. 


The  equations  defining  a  stationary  initial  distribution  ip  are  given  by 


jJq  *<k.ii,i2, 


im-l)  ^1*^2*  •  ■  *  *  ^k-1'%)  ^(il»  •  •  •  W* 


The  existence  of  such  a  distribution  is  assured  by  the  fact  that  the  m-tuples 

7*1 ,  7ji+  j . ’ll+m-l)  ^)rm  a  vector-valued  Markov  process  (reference  [s],  page  89). 

Finally,  we  equate  Pr  {17^  =  l}  with  the  probability  of  at  least  one  jump  in 
an  interval  of  length  6  for  the  Poisson  process ,  and  solve  for  the  appropriate  value 
of  x  *  This  step  is  expressed  by  (2  denotes  the  summing  over  all  subscripted  i’s). 

Pr{  7jj  =1}  =2  Ml.ij,  •  •  •  .ijn-i)  =  I"6 
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The  r)  process  is  now  completely  specified,  and  hence  so  is  T  by  equation  (V-5). 
The  approximate  step-plus -jitter  process  it  is  then  defined  by 


X  =  Z  +  J, 


where 


«*. 

Z 


The  same  reasoning  as  in  the  last  section  shows  that  X  is  stationary  and  m-dependent. 

The  recursive  relations  for  computing  cdp  are  again  found  by  expressing  Ifo 
in  the  form 


(11i  W-l) 


and 


+  2  0(0, 1,4 . i^)  M(n01il‘  ‘ '  im-2> 


+  0(0,0,. ..,0,1)  l400"'01) 


+  0< 0,0,..., o) 


(V-6) 


(lii...i_.i)  (il- •  •  im-i0)  (ii . . .  im_-i  1) 

Mn  m  1  =f(j(*<M1 . im-i;0)Mi-i  m  1  '+*<l,ii, . .  Mn-i  m  1 
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These  relations  may  be  verified  by  examining  the  possible  ways  the  jumps  may  occur. 

The  general  scheme  described  by  equations  V-6  and  V-7  is  applicable  only 
for  finding  where  n>m.  A  modification  would,  of  course,  be  possible,  bit  this 
would  involve  more  labor  than  actually  computing  the  true  Pn  for  n<m.  As  it  is,  we 
still  have  to  specify  the  values  of  in  order  to  initiate  the  recursion.  These 

are  given  by  noting  that 


(i  1  •  •  •  i-rn)  r  I  i 

Mm+1  =  Pr  {Pm+l  I  ^2  =4’  ^3=i2>  •  •  •  ^m+1  =  im>  * 


which  may  be  found  by  inspection.  For  example,  if  m=€,  then 


=  <oWo 


The  number  of  multiplications  needed  to  find  Mn(given  Mn_j  and  the  ratios 
fj+l/fj  for  j=0, . . .  ,m-l)  is 


3  (2m-l)  +1. 


(V-8) 


It  is  important  that  n  does  not  appear  in  (V-8)  since  this  implies  that  the  number  of 
multiplications  required  to  compute  any  is  just  of  the  order  of  n.  However,  the 
fact  that  (V-8)  increases  rapidly  with  m  suggests  that  only  the  approximations  using 
small  values  of  m  would  be  practical  for  most  applications. 
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APPENDIX  A 


SOME  FUNDAMENTALS  OF  STOCHASTIC  PROCESSES 


This  appendix  discusses  some  elementary  concepts  in  stochastic  processes 
relevant  to  the  body  of  the  report.  Although  the  measure-theoretic  approach  to 
probability  theory  has  provided  a  solid  foundation  for  the  subject  and  has  led  to 
many  new  and  important  advances ,  an  effort  has  been  made  here  to  present  the 
necessary  concepts  without  resort  to  measure  theory.  This  discussion  is  certainly 
no  substitute  for  a  text.  For  an  advanced  treatment  of  multivariate  distributions , 
see,  for  example,  Cramer,  reference  [  r  J.  For  the  more  advanced  subject, 
stochastic  processes,  see  either  Doob,  reference  [  s],  or  Rosenblatt,  reference 
[t  ]. 


The  first  section  discusses  random  variables  and  distributions  .  General 
stochastic  processes  are  discussed  in  the  second  section,  while  the  third  section 
is  addressed  to  the  important  class  of  Markov  processes. 

Random  Variables 

An  n-dimensional  random  variable*  X  ^(Xj . X^  may  be  regarded  as  a 

real  vector  which  describes  the  outcome  of  some  experiment  which  may  be  repeated 
(at  least  conceptually)  a  large  number  of  times  under  uniform  conditions.  Associated 
with  the  random  variable  X  is  a  function  H  of  n  variables,  called  its  joint  distribution 
function.*  A  function  H  can  fill  this  role  if,  and  only  if  it  satisfies  the  following 
conditions  (see  reference  [r  ] ,  page  79). 


(1) 

OlHfx!, . . .  ,xn)  <  1 

(2) 

lim  H  (xj , « « . , Xjj)  0  for  i  =  1, . .  •  ,n 

^-♦oo 

j 

(3) 

lim  H(xi, . ..  ,xk)  =  1 

xl» 

*  Such  an  n-tuple  of  one -dimensional  random  variables  is  also  a  stochastic  process 
(next  section).  The  two  terms  refer  to  the  same  object  from  different  viewpoints, 
both  useful. 


A-l 


(4)  H  is  non-decreasing  and  continuous  to  the  right  in  each  variable  X{ 

(5)  The  differences 


H(Xj  +  y^» .  • .  >Xjj  +  y^)  —  H(x-^,  X£  +  y£»  •  •  •  y^) 


-  . . .  -  H(xx  +  yi, . . .  .x,!.!  +  yn_v  Xn) 


+  ...  +  (-l)nH(x1,...,xn) 
must  all  be  non -negative. 

This  function  specifies  the  stochastic  behavior  of  the  random  variable  X  in  the 
sense  that  the  probability  that  Xi  not  exceed  xj  for  i=  1, . . .  ,n  is  defined  to  be 
H(xlt . . .  .Xu).  hi  symbols, 


Pr{Xjlxj  for  i=l,. . .  ,n}  =  HtXj,. . .  .Xjj). 


Thus  1-His  a  cdp. 

The  set  function  Pr  may  be  extended  to  a  much  larger  class  of  sets  than  just  the 
particular  n-dimensional  semi-infinite  intervals  Xi  S  Xj  for  i= 1, . . .  ,n.  See 
reference  [r]  for  the  details  of  this  construction. 

The  conditional  probability  that  X  be  a  member  of  A,  given  X  is  a  member  of 
B,  is  defined  to  be 


Pr{ X  e  A  OB} 

Pr{  X  €  B} 

Suppose  now  that  g  is  a  real -valued  function  of  n  variables  and  integrable  in 
the  Lebesgue-Stieltjes  sense  (see  reference  [r])with  respect  to  H.  Then 
g(X1} . . .  ,Xn)  is  a  random  variable;  its  expectation  is  defined  to  be 


Pr  (X  e  A  | 


E  {  g(Xi, . . .  ,Xn)}  -  /^  /_ ^  S(xi>  •  •  •  »*n)  dH(x^, . . .  ,Xq). 
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The  mean  ,  w,and  the  variance,  <r?,  of  Xj  are  defined  by 


Mi  =E  {Xj} 

(T.2  =  E  {(Xi-Mi)2}, 


when  the  expectations  are  finite  (to  which  case  we  restrict  ourselves) .  The  square 
root,  o-j.of  the  variance  of  Xi  is  called  its  standard  deviation. 

The  correlation  coefficient  p^j  between  Xj  and  Xj  is  defined  by 

E{(Xj-W)  (Xj-Hj)} 


providing  ffj  oj  t  0.  The  concept  of  correlation  permeates  this  report  (Appendix  C 
presents  some  miscellaneous  correlation  results).  Note  that  -1  <  py  <1.  If 
Py  >  0,  then  Xj  and  Xj  tend  to  be  high  together  or  low  together,  and  the  magnitude 
ofpij  is  an  index  of  this  tendency.  If  pjj  <  0  (probably  not  important  in  cdp  problems) , 
then  Xj  tends  to  be  high  when  Xj  is  low,  and  vice  versa.  If  Xj  and  Xj  are  independent 
(defined  below) ,  then  py  =0,  but  not  necessarily  conversely. 

The  correlation  coefficient  between  two  two-state  (i.e.  success -failure)  random 
variables  will  be  denoted  by  r  rather  than  p  .  It  is  important  to  realize  that  the  correla¬ 
tion  between  success-  failure  variables  obtained  by  thresholding  multi-state  variables 
does  not,  in  general,  have  the  same  value  as  the  correlation  between  the  latter, as 
shown,  for  example,  by  Theorem  C-3,  Appendix  C — for  a  non-trivial  case  where  the 
two  are  the  same,  see  Theorem  C-4. 

In  the  one  dimensional  case  (n=l) ,  the  distribution  function  H  is  just  a  non¬ 
decreasing  right-continuous  function  such  that 


lim  H(x)  =1 
x-*-oo 


lim  H(x)  =0. 
x-*-oo 
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If  II  i 3  absolutely  continuous ,  then  ii  is  expressible  in  the  form 


H(x)  =  h(y)  dy, 


where  h  is  called  the  probability  density  function  associated  with  the  random  variable; 
at  points  x  where  H  is  differentiable  (which  is  almost  everywhere)  ,h(x)=H'(x) . 

A  one-dimensional  random  variable  X  is  said  to  be  normally  distributed 
when  it  has  a  density  function  h  of  the  form 


h(x)  - - - 

a/27 


e  2<  <r  ' 


A 

here  a  is  the  variance  and  n  the  mean  of  X.  '  density  function  of  the  normally 
distributed  random  variable  with  p  =0  and  a  2='  called  the  standard  normal  density 
and  is  denoted  by  cp.  In  this  case,  the  corresponding  distribution  function  is 
called  the  standard  normal  distribution  and  is  denoted  by 

In  general,  if  a  joint  distribution  function  H(xp  . . . , xn)  may  be  expressed  in 

the  form 

H(xi»  •  •  •  ^  h(y2 . yn)  dyi  dyn> 


then  h  is  called  the  joint  density  function. 

The  random  variables  Xj, . . .  ,Xn  are  said  to  be  multivariate  normal  whenever 
their  joint  distribution  function  H  has  the  following  density: 


h(x)  = 


(2*) 


y|  2 


exp  (-i(x-p)  V 


-1 


(x-M)’}  , 


(A-l) 


where  x=(x^, . . .  ,xu) ,  p  =  (/u^, . . ,  ,pn)  and  V  is  the  non-negative  definite  symmetric 
matrix  of  covariances  V^j  -  <7j  oj  p^j  (the  prime  denotes  the  transpose) — again  and 

cr?  are  the  mean  and  variance  cf Xj  respectively.  The  symbol  |  v|  denotes  the  deter¬ 
minant  of  V.  Strictly  speaking,  the  distribution  thus  defined  is  called  non-singular 
multivariate  normal,  owing  to  the  nonsir^ula’  ity  of  V.  A  more  general  definition 
of  multivariate  random  variables  is  avail  ^.e  which  applies  even  when  |  v|  =0. 
However,  in  this  case,  the  variates  do  not  have  a  density  function  and  we  will  not 
consider  this  case  further  (see  reference  [  r  ] ,  page  312) .  Note  that  =  cr?  and 
hence,  if  we  wished,  we  could  express  the  correlations  in  terms  of  the  covariances 

by 


P 


ij 


Vii  V 


11  JJ 


When  n=2  and  and  X2both  have  mean  zero  and  variance  one,  formula  (A-l)  becomes 


xl_i5P  xlx2  x2 


h(Xl,x2)  - ■—=.  exp  [ - — — - 

2ttViI^T  2(l-p2) 


]» 


where  p  is  the  correlation  coefficient  between  Xj  and  X2-  This  is  the  bivariate  normal 
distribution  —  it  is  tabulated  in  reference  {  p  J ,  which  is  very  useful  in  the  methods  of 
Chapter  HI.  While  there  are  numerous  applications  of  the  multivariate  normal  through 
out  the  statistical  literature,  our  present  interest  is  in  its  use  in  the  description  and 
study  of  Gaussian  processes  which  are  defined  in  the  next  section. 

In  concluding  this  section, we  define  the  important  concept  of  independent 
random  variables .  This  is  most  easily  done  in  terms  of  marginal  distributions. 

As  before,  let  X  =(Xi, . . . , X^) ;  then  the  marginal  distribution  Hj  of  Xj  is  defined  by 


Hi(x)  =  Pr  {Xj  <  x}  =  H(oo, oo, . . .  ,x, . .  .oo), 


where  x  is  the  i^  argument  of  the  joint  distribution  function  H  of  X.  The  random 
variables  Xp  • . .  ,Xn  are  then  said  to  be  independent  if 
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H(xv  . . .  .Xjj)  =  H1(x1)  H2(x2)  •  •  •  Hn(xn) . 


If  Xi  and  X2  are  independent,  then  we  can  express  the  distribution  function  H  of  their 
sum,  Xi  +  X2,by  the  formula 


H(x)  =  H^x-y)  d  H2(y), 

where  H  is  called  the  convolution  of  H  j  and  H2  (used  in  Chapter  IV) . 
Stochastic  Processes 


A  stochastic  process  X  is  simply  defined  to  be  an  indexed  collection  of 
random  variables  X^.  We  restrict  each  Xj-  to  be  one-dimensional  unites  noted  other¬ 
wise.  The  set  of  indices  t  is  called  the  parameter  set  of  the  process.  In  this  report 
the  parameter  set  is  restricted  to  be  either  the  half  line  [0,oo)  in  which  case  the  process 
is  said  to  have  a  continuous  parameter  or  the  positive  integers,  in  which  case  the 
process  is  said  to  have  a  discrete  parameter.  In  order  to  make  this  definition  precise, 

one  must  specify  the  joint  distribution  of  every  finite  sub-sequence  (X^ . X^)  of 

the  random  variables  in  a  consistent  manner.  Let  . .  +  denote  the  joint  dis¬ 
tribution  function  of  (X^  X^);  then  the  following  conditions  must  be  satisfied: 


(1)  If  k  is  a  permutation  of  the  integers  1, . . .  ,n,  then 


Ht  t  ...t  <V . xx>=Ht . t  (X1 . V 

k  k  k  1  n  I  n 

12  n 


(2)  If  1  <  j  <  n  and  x^, . . .  ^  approach  infinity,  then 


Htj  t2- .  -tj  (xl»’ '  *  ,xj)  **t]t2-  •  -tn  (xl»  *  ’ '  »xj>°°»  •  • 


,oo) . 
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The  set  of  possible  values  that  the  random  variables  may  assume  is  called 
the  state  space  of  the  process  When  the  random  variables  can  only  assume  a  finite 
or  a  countable  number  of  valves ,  the  state  space  is  said  to  be  discrete,  and  when  the 
random  variables  can  assume  an  uncountable  number  of  values ,  the  state  space  is 
said  to  be  continuous .  The  underlying  stochastic  processes  X*discussed  in  Chapters 
in,  IV,  and  V  all  have  a  continuous  state  space,  while  the  two-state  process  D 
discussed  in  Chapter  II  has  a  discrete  state  space. 


A  Gaussiar  process  (treated  in  Chapter  III)  is  simply  defined  to  be  a  stochas¬ 
tic  process  for  which  all  the  joint  distributions  Hx  x  *  are  multivariate  normal. 


A  process  X  is  defined  to  be  stationary  if  and  only  if 


Pr  {  X/c.  <  xj  for  i=l, . . . ,  k}  =  Pr  {  Xt  +S  j<  xj  for  i=l, . . .  ,k}  , 


that  is , 


**tj. .  .t|^xl’  •  •  *  »xk)  ^tj+s.tghs,  . . .  .tfc+s  (xi»  •  •  •  »xk)‘ 


One  may  express  the  content  of  these  equations  by  saying  that  the  stochastic  behavior 
•  of  the  process  is  invariant  under  displacements  in  time.  If  the  process  is  stationary, 

J  then,  assuming  that  the  means  and  covariances  are  defined, 

I  (1)  the  mean  and  variance  of  Xt  are  independent  of  t;  and 

(2)  the  correlation  ps  ^  between  Xs  and  X*  depends  only  upon 

I  s-t|  • 

Associated  with  any  stationary  process  is  the  autocorrelation  function  a ,  which  is 
defined  by 


“<S)=Pt,S+f 
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n  * 


whenever  both  t  and  s+t  are  parameters  of  the  process.  If  X  and  W  are  stationary 
stochastic  processes,  with  the  same  parameter  set,  then  their  cross -correlation 
function  is  defined  by 


P  (s)  = 
XW 


E{(Xs+t-E{X3+t})(Wt-E{Wt})  } 

ax°w 


where  and  are  the  common  variances  (not  zero)  of  the  X  and  W  processes 

respectively  (cross-correlation  arises  in  this  report  only  in  Theorem  C-l  of  Appendix 

C) .  Note  that  when  X  is  a  discrete-parameter  process,  the  domain  of  a  will  be  the 

entire  set  of  integers,  and  when  X  is  a  continuous -parameter  process,  the  domain 

of  a  and  p  will  be  the  entire  set  of  real  numbers.  Also  note  that  a(s)  =  a(-s) . 

XW 

A  discrete  parameter  process  X  is  said  to  be  m-dependent  if  Xj  and  Xj  are 
independent  whenever  |  i-j  |  >m.  This  type  of  process  was  useful  in  approximating 
the  "step-plus- jitter"  process  in  Chapter  V.  The  autocorrelation  function  a  for  a 
stationary  m-dependent  process  has  the  property  that  a(s)  =  0  for  |  s  |  >m. 

Markov  Processes 


Finally  we  discuss  the  important  class  of  Markov  processes .  A  Markov 
process  may  be  thought  of  as  a  process  where  future  behavior  is  independent  of  the 
past,  given  exact  knowledge  of  the  present.  We  may  express  this  formally  as 


Pr{APlB  Xi=  x}  =  Pr  {  a|  X^  =x}  Pr  {b|  X^  =x}  , 


where  A  is  an  event  defined  by  a  condition  on  random  variables  with  subscripts  less 
than  t  and  B  is  an  event  defined  by  a  condition  on  random  variables  with  subscripts 
greater  than  t.  An  equivalent  formulation  of  this  statement,  known  as  the  Markov 
property,  is  that 

Pr  {\+i-y\Xtn=xn . \  =*1>  =Pr{xtn+i^l>:tn  (A"2) 
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for  any  t1<t2<- . .  <tn+1. 


Suppose  for  the  time  being  that  both  the  state  space  and  the  parameter  of  the 
process  are  discrete  (this  case  is  often  referred  to  as  a  Markov  chain) .  For  conven¬ 
ience,  we  denote  the  states  by  the  positive  integers,  i=l,2, . . .  .  Let  the  transi¬ 
tion  matrix  (or  transition  function)  'kj  and  the  initial  probability  vector  ip  be  given  by 


*j(k,h)  =  Pr{  Xj  =  h  IXj.-^k} 


and 


H  k)  =  Pr{  Xj  =  k} 


respectively.  Using  the  Markov  property  (as  expressed  by  equation  (A-2) ), joint 
probabilities  may  be  computed  by 


Pr{Xi  =ki, . . .  ,Xn  =kn}  =  kx)  ¥2(k!,k2). . .  *n  (kn-l»kn)*  (A-3) 


From  formula  (A-3)  one  obtains  formula  (II-5)  of  Chapter  n  directly. 
Defining,  forl>i, 


*u(k,h)  =Pr{X!=h  |x*=k}, 


the  matrix  gives  the  probabilities  of  transition  from  time  i  to  time  1  and  is  comput¬ 
able  by  the  matrix  product 


¥ 


1 

•  ,  =  n 

i.l  j=i+l 
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Multiplication  of  transition  matrices  can  be  useful  in  cdp  problems  by  use  of  "trapping 
states. "  To  illustrate,  we  give  an  alternative  derivation  of  formula  (n-5)  of  Chapter  II 
in  this  fashion.  Replace  the  transition  matrix  of  Chapter  II,  by 


success 


failure 


success  failure 
1  0  ^ 

bj  bi  ) 


Here  "success"  is  a  trapping  state — once  entered  it  cannot  be  left.  If  one  multiplies 
these  matrices  for  j=2, . . .  ,n,  then  the  lower  right  entry,  bj  >  of  the  product  is 
the  probability  that  D£=. .  .=IL=0,  given  Dj  =0.  Thus 


pn  =Pl  j52bj  ’ 


which  is  the  formula  (H-5) .  If  the  trapping  state  had  not  been  used,  then  by  multi¬ 
plying  transition  matrices  we  would  merely  obtain  relations  between  the  first  and 
final  trials  without  regard  for  outcomes  of  intermediate  trials. 

If  the  transition  matrices  ^  are  independent  of  j,  i.e. ,  ^j  =  1ir,  then  the 
process  is  said  to  have  a  stationary  transition  mechanism.  This  will  be  the  case, 
for  example,  when  the  process  is  stationary.  However,  it  is  quite  possible  for  the 
process  to  be  non-stationary  and  still  have  a  stationary  transition  mechanism. 

In  Chapter  II  we  have  considered,  in  detail,  the  success -failure  process  D 
as  being  two-state  Markov-  There  it  was  noted  that  the  transition  matrices  ^j  could 
be  conveniently  expressed  in  terms  of  the  correlation  r^  between  Dj  and  Dj_i  and 
the  single-trial  probabilities  Pj  and  p._^. 

One  apparent  generalization  of  the  Markov  process  is  the  notion  of  an  m-stage 
Markov  process.  Here,  the  conditional  probabilities  satisfy  a  condition  analogous  to 
(A-  2)  rnmely, 
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Pr^Xn+l"kn+l I  ‘  *  * ,X l_kl^  ~  pr^Xn+l“kn+l I  Xn"kn’  *  * '  ,Xn-m+l^n-m+l^  * 


Intuitively,  this  means  that  the  probability  of  moving  into  a  new  state  is  independent  of 
history  of  the  process  more  than  m-steps  into  the  past.  (These  processes  are  also 
called  "muwiple"  Markov  processes,  reference  [  s  ],  page  89,  or  "m-step"  Markov 
processes,  reference  [  t  ] ,  page  60.)  It  is  worth  mentioning  that  the  associated  vector¬ 
valued  process,  •  • .), where 


(Xj,Xj+j> . . . , X j — i )  for  i  1,2, .. . 


is  just  an  ordinary  Markov  process ,  and  it  is  sometimes  useful  to  use  this  fact.  We 
use  m-stage  Markov  processes  in  Chapter  V  in  connection  with  an  approximation  to 
the  "step-plus- jitter”  process. 

Suppose  now  that  the  Markov  process  has  a  continuous  parameter.  (We  still 
assume  the  state  space  to  be  discrete.)  Let  the  matrix  ¥s>t  be  defined  by 


¥S|t(k,h)  =Pr{Xt=h  |Xg=k}, 


for  each  pair  of  parameter  values  s,  t  such  that  t  >s.  As  before,  the  Markov  property 
(expressed  by  equation  (A-2))allows  us  to  compute  joint  probabilities  fay  the  relation 


"kn}=Pr{xt1=ki}*t1  •  •Vl-tn(k“-1’ 


The  transition  matrices  satisfy  the  equation 


*s,t  =  %,T  *T,t» 


analogous  to  (A-3)  for  a  Markov  chain.  When  ¥g  t  depends  only  upon  (t-s) ,  the  transi 
tion  mechanism  is  said  to  be  stationary.  Again,  this  will  be  the  case  whenever  the 
process  itself  is  stationary.  The  Poisson  process  N,  used  in  the  definition  of  "step" 


A-ll 


and  ,,step-plus-jitter"processes,  is  an  example  of  a  discrete-state-space  Markov 
process  with  a  continuous  parameter.  Its  transition  matrices  are  given  by  (reference 
[  t  ] ,  page  122): 


flU(h-k)  -X(t-s) 
[  A(t-s)j  e 


(h-k)t 


*s,t<k’h>  = 


for  h  >  k 


for  h  <  k. 


Here  the  state  space  is  assumed  to  be  the  non-negative  integers  k=0, 1, . . . ,  and 
Nq  =  0.  Clearly,  even  though  the  transition  mechanism  is  stationary,  the  process 
is  not,  since 


Pr{Nt=k}  = 


Ut]k 

k! 


e~*t  t 


which  depends  upon  t. 

A  discussion  similar  to  the  above  may  be  carried  out  for  the  case  of  a 
continuous  state  space  (see  reference  [  t  ]).  It  is  worth  noting  that  the  step  processes 
in  Chapter  IV  are  continuous-state-space  Markov  processes  (this  fact  is  not  used 
explicitly,  however),  and  that  in  Chapter  in,  Theorems  in-2  through  HI-4  are  based 
on  the  assumption  of  a  Gaussian  Markov  process.  It  should  also  be  noted 

that  the  autocorrelation  function,  a ,  of  a  large  class  of  stationary  Markov  processes 
(including  step  processes  and  stationary  Markov  Gaussian  processes)  is  of  exponential 
form,  i.e. ,  o?(s)  =e"*,s  (see  reference  [s  ],  page  234). 
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LITERATURE  SURVEY  ON  EVALUATING  THE  MULTIVARIATE  NORMAL  DISTRIBUTION 


The  purpose  of  this  appendix  is  to  survey  the  previously  published  work 
which  has  direct  bearing  on  the  problem  of  computing  cdp  for  the  class  of  Gaussian 
processes.  As  noted  in  Chapter  I,  this  problem  is  equivalent  to  evaluating  the 
multivariate  normal  distribution  function.  The  paper  of  Gupta,  reference  [v], 
together  with  his  extensive  bibliography,  reference  [u],  provide  an  excellent  review 
of  previous  results  on  this  subject  and  provide  the  basis  for  the  discussion  in  this 
appendix. 

As  elsewhere,  we  denote  by  Pn  the  value  of  cdp  relative  to  a  fixed  threshold 
function  T.  That  is,  cdp  is  given  by 


Pn  =  1  -  Pr  {Xi<  Ti  for  i=l . n}  , 


where  Xj, . . .  ,Xn  are  multivariate  normal.  Unless  noted  otherwise,  the  random 
variables  Xi  will  be  assumed  to  have  mean  zero  and  variance  one.  This  assumption 
causes  no  loss  in  generality,  since  if  this  is  not  the  case,  we  may  consider  the  new 
random  variables  Xj,  defined  by 


Xi-Mi 


t 


where  pj  and  of  are  the  mean  and  variance  of  Xj 


The  random  variable  3^  will  then 


i 

i 
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have  mean  zero  and  variance  one.  Moreover,  the  correlation  between  X[  and  Xj 
is  the  same  as  the  correlation  between  and  Xj . 

Most  results  relating  to  the  exact  computation  of  Pn  fall  into  the  following 
three  categories: 

(1)  attempts  to  express  Pn  in  a  closed  form  involving  tab¬ 
ulated  functions  (usually  associated  with  some  very 
special  selection  of  the  numbers  Ti,  e.  g. ,  'll  =0  for 
i=l,...,n.); 

(2)  the  computation  of  Pn  in  terms  of  an  infinite  series 
expansion  or  the  expression  of  Pn  as  a  single  definite 
integral;  and 

(3)  attempts  to  give  reduction  formulas  foi  Pn  ,i.e. ,  methods 
of  expressing  Pn  in  terms  of  the  multivariate  normal 
distribution  for  fewer  than  n  random  variables. 

Clearly,  results  in  the  first  category  would  be  most  satisfactory  for  our 
purposes  if  they  were  sufficiently  general.  However,  the  results  in  reference  [  v  ] 
in  this  category,  which  we  now  discuss, are  restricted  to  the  special  case  where 
Tj  =_0  for  1  <i  <  n.  Even  then  there  are  no  general  closed  form  expressions  available 
for  Pn  when  n>3.  The  expressions  for  n=2  and  n=3  are  Diven  by 


and 


Po  =  1  +  (a™  gfe-P) 

^4  2tt 


(B-l) 


P3 


1 

8 


(arc  sin  p12  +  arc  sin  p13 


+  arc  sin  p23) , 


(B-2) 


where  pjj  is  the  correlation  coefficient  between  Xj  and  Xj,(  see  reference  ( v  1 .  page 
801).  For  n  odd  the  following  recursive  relation  is  given  by  Davis,  reference  [  w]  - 


Pn  =  i  U-S  Pi  +  S  +  . .  ■+(-l)n'1  S  Pn.il; 


(B-3) 
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here  Pj  represents  the  probability  that  all  of  a  given  selection  of  j  of  the  X's  are 
negative, and  the  summation  is  extended  over  all  (j1)  combinations.  In  fact,  formula 
(B-2)  was  computed  making  use  of  (B-l)  and  (B-3) .  For  n  larger  than  3,  however, 
the  intermediate  values  of  Pj  for  j  even  must  be  known,  and  at  the  present  time 
these  are  not  available  in  closed  form. 

If  the  correlation  matrix  is  restricted  to  certain  special  types,  then  formulas 
for  Pn  may  be  found  for  n>3.  As  a  case  in  point,  suppose  all  the  correlations 
between  distinct  random  variables  are  equal  to  i.e.  =  £  for  i/j.  Then  one 
has  (reference  (v  ]) 


(B-4) 


Another  special  case  is  where  the  inverse  V"1  =  (w^j)  of  the  covariance  matrix  is 
such  that 


2  if  i=j 

wH  =<j  -1  is  |  J- j  |  =  1 
0  otherwise 


Here,  Anis  and  Lloyd  have  proved  that  (reference  [x  1) 


-3/2 

Pn  =  (n+1) 


Note  that  here  the  random  variables  Xi  are  not  assumed  to  have  variance  1,  in  fact 
for  n=2,  each  random  variable  Xi  has  variance  2/3. 

While  the  aforementioned  results  are  interesting  from  a  theoretical  point  of 
view,  they  are  much  too  restrictive  to  be  of  any  use  at  all  in  computing  cdp  in  practical 
situations. 
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Fesults  in  the  second  category  are  somewhat  less  restrictive  but,  of  course, 
their  application  must  deal  with  problems  of  convergence  or  numerical  integration. 

An  example  would  be  the  following  formula,  reference  [y  J,  (we  are  no  longer  restricted 
to  Tj  =  0,i=l, . . .  ,n): 


Pr 


\X  j<.Ti  for  i  =  1, . 


n  Ti-o^y 


>n}=  J"  [  JL  *  (■  q 
00  1-1  (1-a?) 


r)l  <P( y)  dy,  (B-5) 


providing  the  correlations  py  are  given  by  py  =  for  i^j.  Here  #  is  the 
standard  normal  distribution  function  and  (p  is  the  standard  normal  density  function 
For  more  general  types  of  correlation,  there  are  expansions  forl?n  in  terms  of 
generalized  tetrachoric  series,  reference  [  v  ] .  However,  these  are  quite  compli¬ 
cated  and  converge  very  slowly  for  high  values  of  |  pjj  |  . 

The  results  in  the  third  category  are  rather  snarse  and  have  the  disadvantage 
of  reducing  the  given  problem  to  another  which  may  still  not  have  a  satisfactory  solu¬ 
tion.  For  example,  John,  reference  [  z  ],  obtains  a  formula  for  evaluating  the 
probability  integrals  Ifo  in  n-dimensions  if  those  of  (nr  1) -dimensions  are  available. 
Plackett,  reference  [aa],  also  gives  a  reduction  formula  applicable  for  arbitrary  n, 
but  its  application  is  quite  laborious  when  n  is  large  (see  page  804  of  reference  [  v  ]) . 

In_addition  to  exact  expressions,  there  are  a  number  of  results  in  finding 
bounds  on  Pn  The  most  useful  result  along  these  lines  for  present  purposes  is  the 
result  of  Slepian,  reference  (bbl ,  which  shows  how  Ifc  changes  with  the  correlation 
Pij-  The  precise  statement  of  this  theorem  is  as  follows: 

Theorem  B-l  (Slepian).  Let  (X p . . .  ,Xn)  and  (Xj, . . .  ,Xn)  be  multivariate 
normal  with  means  zero,  variancts  one,  and  correlations  respectively  pjj  and  pjj . 
Then  if  py  for  all  i,  j  the  inequality 


Pr{Xi<  Ti  for  l<i<n}>  Pr{Xi<Ti  for  l<i<n} 


holds  for  arbitrary  T^ , 


>'**T 


We  now  give  the  following  two  applications  of  this  theorem  to  the  approximation 

of  cdp. 


Application  1.  One  can  show,  using  Slepian's  method,  (see  Berman,  reference 
[cc])  that,  when  Tj  =  To>  for  i=l, . . .  ,n, 


<  jl 

<k  "2* 


2  A 


(i-pkf)  exp  [  - 


(1+Pkl) 


]• 


(B-6) 


For  convenience,  let  the  right  hand  side  of  (B-6)  be  denoted  by  9  (Tq.p^)  • 
that  (as  in  the  stationary  case)  py  depends  only  on  |  i-j  |  ,  and  define  Pj  =  p 
Using  the  law  of  the  mean,  we  have 


Suppose 

l+j,l* 


where  Xj  are  independent  and  normally  distributed.  Since 


Pr{Xi  <  T0  for  l<i<n}  =  *(T0)n, 


where  $  is  the  cumulative  normal  distribution,  we  have  a  bound  on  Pn. 

Application  2.  One  can  use  Slepians  theorem  in  still  another  way.  If 


p.j  =  p  for  tfj,  l<i,  j<n, 


then  it  can  be  shown  (reference  [  vj)  that  the  desired  cdp  is  ( 

I 

f 
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Pr{Xi<Ti,  for  l<i<n}  = 


~  n  Ti-p2y 

UA*ej^jrnd*w. 


where  $  is  the  normal  distribution  function.  This  is  a  special  case  of  equation  (B-5) 
given  earlier.  Therefore,  if  py  are  not  constant,  let 


p  =  min  p..  and  p*  =  max  pH, 

tfj  13  3 


and  then 


n 

n :  *( 

i=l 


Tj-Pay 

d-p)5 


)  d$(y)  <  Pr  {Xi<  T;  for  l<i<n}<  f°°  .n$(Ti  p*-^ 

1  ~  -001=1'., 

(l-p*)2 


-)d$(y). 


See  reference  [  v  ]  for  more  details.  If  the  Tj  h  Tq  for  i=l, . . . ,  n,  then  we  have  the 
slightly  simpler  formula 


/: 


00 

00 


Tn- p2y 

$n  (_ - d$(y)  <  Pr  {Xi<T0  for  all  i,  l<i<n}<£c 


(1-0)2 


00 

00 


*n( 


f-p^2y 


r)d^(y)  • 


Tables  of  values  foi  integrals  of  this  latter  type  have  been  made  for  selected  values 
of  Tq , p  (or  p *) ,  and  n  in  reference  ( v  ]• 
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APPENDIX  C 


CORRELATION  THEOREMS 


In  this  appendix  we  present  four  theorems  concerning  correlation,  which 
are  relevant  to  cdp  calculations. 

Theorem  C-l  gives  a  for*  lula  for  the  autocorrelation  of  the  sum  of  two 
stochastic  processes.  Theorem  C-2  presents  elementary  facts  on  correlation  be¬ 
tween  two -state  random  variables.  Theorems  C-3  and  C-4  relate  the  autocorrela¬ 
tion  of  a  multi-state  process  to  that  of  a  two-state  success-failure  process  obtained 
by  thresholding. 

Autocorrelation  of  a  Sum 


Theorem  C-l  presents  a  formula  for  the  autocorrelation  function  of  a 
stationary  stochastic  process  which  is  the  sum  of .  two  (cross-correlated)  station¬ 
ary  stochastic  processes .  In  general  this  theorem  is  useful  in  synthesizing 
empirical  estimates  of  correlation  from  estimates  on  additive  component  processes . 
Note  that  if  there  is  no  cross  correlation  between  X  and  W,  then  a  simpler  state¬ 
ment  of  the  theorem  is  that  the  autocovariance  (variance  times  autocorrelation)  of 
X  +W  is  the  sum  of  the  autocovariances  of  X  and  W. 

Theorem  C-l.  If  X  and  W  are  stochastic  processes  with  constant  means  /xj 
and  ,u2.  constant  standard  deviations  and  <72,  and  autocorrelation  functions  ai 
and  (*2  respectively,  then  the  autocorrelation  of  their  sum  is 


+  <t22q!2^+0'10'2  [P<s)  +p  (“8)1 
a(s)  - - - - 

Oj2  +  4  +  2cr10'2(p  (0)) 


where  p  is  the  cross -correlation  function  between  X  and  W. 


Proof.  We  have,  denoting  the  variance  of  X  +  W  by  cr2, 


ct2c*<S>  =E{(X  +  W)t  •  (X  +  W)t+3 }-<)*!  +H2)2 
=  E  {XtXt+s}  -  n2  +  E{WtWt+s}-M22 
+  E{XtWt+s}  -M1M2  +E{Xt+sWt}  -  Ml  M2  • 


It  is  easily  shown  that 


0-2  -  +  +  2o-j  or 2  p  (0) . 

Since  E  { Xt+sWt  }  =  E{ X^_s}  ,  the  theorem  follows.  ##### 


Correlation  Between  Two-State  Variables 

The  following  theorem  presents  three  statements  concerning  the  correlation 
of  random  variables  over  a  two  point  sample  space.  Statement  (ii)  is  used  in  proving 
Theorem  C-3. 

Theorem  C-2.  Let  and  D2  be  two  random  variables  over  the  same  two- 
point  state  space  {O,  l}  .  Let 


Pi  =  Pr{Di=l}  ,  p2  =  Pr{D2=l> 


and 


z  =  Pr{  Dj=  0  and  D2=  0}  . 


Then 


(i)  z  <  pp  z  <  p2,  andpx  +  p2  <  1  z; 

(ii)  if  0  <  p1,P2<  1,  then  the  correlation  coefficient  r  between  and 
D2  is 


C-2 


ys-w-w 


z-P~lP2 

v*p1p1p2p2  ’ 


Note  that  the  quantities  in  the  conclusions  do  not  depend  on  the  state  designation  — 
they  could  be  arbitrary  numbers  and  the  same  results  hold. 

Proof.  Statement  (i)  is  obvious.  Proof  of  (ii)  is  straightforward  computation, 
noting  that  when  z  ,plf  and  P2&re  given,  the  other  three  joint  probabilities  between 
and  D2  are  determined.  Statement  (iii)  follows  from  (ii)  and  (i) .  ##### 

* 

Correlation  in  Thresholded  Processes 

Theorem  C-3  provides  an  inequality  comparison  between  the  autocorrelation 
of  a  stationary  Gaussian  process  with  that  of  an  associated  success-failure  process, 
obtained  by  thresholding.  Since  any  two  observations  of  a  Gaussian  process  are 
random  variables  whose  joint  distribution  is  bivariate  normal,  random  variables 
rather  than  processes  are  treated  in  the  theorem.  One  implication  of  the  theorem 
is  that  the  success -failure  process  associated  with  a  Markov  Gaussian  process  need 
not  be  Markov  (e.  g.  the  special  case  where  T  equals  the  means  and  equality  holds — 
if  r  is  exponential,  sin~l  r  is  not  exponential). 

Theorem  C-3.  Let  Xi  and  X2  be  a  pair  of  random  variables  whose  joint 
distribution  is  bivariate  normal  with  correlation  coefficient  p  .  Let  Dj  and  D2  be 
formed  by  collapsing  X[  and Xg into  the  two  states  0  and  1  by  use  of  a  threshold  T: 

Dj  =  1  if  and  only  if  X^>T 
D2  =  1  if  and  only  if  X2>T. 

Let  r  be  the  correlation  coefficient  between  and  D2-  Then 
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1.1.2  _._-l  |  |,|  | 

: r  i  i  y  Bm  i  p  i  i  i  p  i » 


and 


r>0  if  and  only  if  p  >0. 


If  T  =  E  {  X^}  =  E{X2}  ,  then  }  r  |  =  (2/tt)  sin"1  (  p  {  (in  this  case  r  is  sometimes 
called  "clipper  correlation.  ” 

Proof.  We  pa  ay  just  as  well  assume  that  Xi  and  X2  each  have  zero  mean  and 
unit  variance.  The  threshold  T  defines  the  following  regions  A,  B,  A\  B',  in  the  plane: 


For  L  a  rectangular  subset  of  the  plane,  let 


F(L)  =  // 
L 


1 

27rVri_p2 


x2-2pxy+y2 

exp  [-  - r — j  dxdy. 

2(1~P  2) 


We  then  have,  by  Theorem  C  -2(ii) , 


F(B) 

r  =  1 - 

F(/U  B)  ll-F(AU  B)] 


Let 


<p(x)  = 


e 


=  /  <p(x)dx, 
-z 
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and 


Then  it  is  straightforward  to  show  that 


_d_ 

dT 


F(B)  =  -  <p( T)  *  (kT) 


and 


-£7  F(AUE»  =-«>(T). 
dT 


It  follows  that 


dr  _ _ <P( T) _ 

dT  F(AUB)  [1-F(AUB)] 


[¥(kT)  -  (1-r)  ¥  (T)J. 


(C-l) 


Letting 


n(T,p) 


*  (kT) 
*(T) 


we  see  from  formula  (C-l) that 


dr 

dT 


>0  if  and  only  if  r  >l-0(T,p). 


We  show,  hy  contradiction,  that  if  p  >0,  and  T>  0  (which  implies  1-  Q(T,p)  is 
positive  and  decreasing  with  T) ,  then  dr/d  T  <0.  Let  p  >0  and  assume  that,  for  some 


Tq  >  0  2nd  corresponding  r^ . 


dr 

dT 


>0. 


Then  rc  >  l~fl(T,  p)  and,  since  this  inequality  will  hold  for  all  T  >T^ ,  we  have  r  >  rQ 
for  T  >  Tjj.  It  then  follows  from  equation  (C-l)  that  dr/dT-*oo  as  T-no, since 


f<aU  §'  *  “ 


by  I’hospital’s  rule.  This  implies  r>l,  a  contradiction.  Therefore, 


P 


> 


0  and  T  >  0  implies 


0. 


(C-2) 


In  a  similar  fashion,  if  r<  0  when  P>0  and  T>  0,  then  dr/dT-*-oo  as  T-^oo; 
thus  r  <-l,  in  contradiction.  Therefore, 


p  >0  and  T>  0  implies  r  >0. 


(C-3) 


By  similar  contradiction  arguments , 


dr 

p  <  0  and  T>  0  implies  r<0  and  >  0, 


(C-4) 


for,  in  this  case,  1  -fi(T,p)  is  negative  and  increasing  with  T. 

Now,  by  symmetry,  r  corresponding  to  T.  equals  r  corresponding  to  -T; 
thus  |  r  |  obtains  it  maximum  at  T-J  and  relations  counterpart  to  (C-2) ,  (C-3) ,  and 
(C-4)  hold  for  T  <  0. 
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When  T=0, 


F(B) 


-J-  a-  —  81”'1?) 


and 


F(AU  B)  =-|- 

2  .  -1 
r  =  —  sin  p . 


The  conclusion  now  follows . 


innnnr 


The  bound  on  r  given  by  Theorem  C-3  is  tabulated  as  follows: 


if  Ip  1 _ 2. _ 

Then  |r|  <  sin-1|p  |  =  0 


.1  .2  .3  .5  1.0 

.06  .13  .19  .33  1.0 


The  final  theorem  again  deals  with  a  two-state  process ,  this  time  obtained  by 
thresholding  a  step  process  rather  than  a  Gaussian  process.  The  result  here  is  more 
easily  applied,  since  one  finds  that  the  autocorrelation  of  the  two  processes,  the  step 
process  and  the  success-failure  process, are  equal. 

Theorem  C-4.  Let  X  be  a  step  process ,  with  l/  A  a?,  the  mean  separation 
between  jumps.  Let  D  be  the  two  state  (success-failure)  piocess  formed  by  a  grouping  of 
all  values  of  X  above  a  threshold  T  ir  >  success,  and  all  other  values  of  X  into  failure. 
Then  the  autocorrelation  function  associated  with  these  processes, a-%  and  a  j  5  respect¬ 
ively,  are  equal: 


Ox(s)  =  oft  (s)  =  e 


-As 


for  s  >0. 


Proof.  By  Theorem  C-2  the  autocorrelation  associated  with  D  is 


aD(s)  = 


u(s)  ~  p" 

P(l-P) 


where 


p  =  Pr {X  >  T} 


u(s)  =  Pr  { Xj.  >  T  and  X^g  >  T> 


Since  X  is  a  step  process , 


’(s)=pte“Xs  +  (l-e'Xs)p], 


-As 

where  e  is  the  probability  of  no  jump  in  X  during  a  separation  s .  Therefore, 


«n<s>  = 


_  P[e~Xs  +  (l-e’~Xs)  p]  -p2  _  -As 


P(l-P) 


=  e 


Now  consider  the  autocorrelation  associated  with  X.  Let  H,  /ti ,  and  a2  be  the 
distribution  function,  mean,  and  variance  of  Xj  (same  for  all  t).  Then 


E  {XtXt+s}  =  C  l  x2e"XS  +  (1  “  eXs  )  xfl  ydH(y)]  dH(x) 


=  /  00  (x2e“Xs+  (1  -e~AS)  xy]  dH(x) 


=  e  (<r2+^2  )  +y2(l-e~Xs) 
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=  e~As<r2  +  p 2 


so  that 


ax(s)  = 


E{(Xr(.)  (Xt+S-(1)}  E{XtXs  >  -  A.2 


-\a 


Thus,  Qlx  =Q!d 


##### 
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